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Our  primary  experimental  approach  has  been  to  record  from  single  neurons  in 
awake,  behaving  animals  in  order  to  determine  the  loci  of  neurons  with  condi¬ 
tioning-related  activity  and  to  quantitate  the  relationship  of  this  activity 
to  the  expression  of  the  conditioned  response.  Our  theoretical  approach  has 
been  to  extend  simple  computational  models  of  connectionist  learning  into 
physiologically  plausible  neural  networks  that  describe  real-time  features  of 
conditioned  behavior.  These  network  models,  and  their  possible  implementations 
in  the  brain,  suggest  experimental  tests  and  provide  direction  for 
physiological  studies. 
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I.  Summary 

There  are  two  widely  recognized  reasons  why  theoretical  and  biological  studies  of  the  condi¬ 
tioned  response  are  importent  for  adaptive  networks  research.  First,  conditioned  response  learning, 
or  classical  conditioning,  lies  at  the  conceptual  center  of  connectionist  learning.  Experimental  psy¬ 
chologists  who  investigate  classical  conditioning  believe  their  research  is  about  the  development  of 
associative  ‘knowledge  structures’,  and  they  use  any  system  or  preparation  that  elucidates  funda¬ 
mental  mechanisms  by  which  these  structures  are  acquired,  maintained,  and  modified.  This  line 
of  enquiry  has  given  rise  to  theoretical  models  of  learning  that  have  been  applied  to  engineering 
control  problems,  robotics,  decision  making,  and  optimization.  Secondly,  classical  conditioning  lies 
at  the  heart  of  neurobiological  studies  of  learning  from  systems  to  cellular  levels. 

One  goal  of  a  computational  approach  to  learning  is  that  it  provides  the  ideal  instrument  for  a 
deep  (rigorous)  understanding  of  learning  at  the  functional  level  while  at  the  same  time  providing 
insight  into  underlying  biology.  Useful  computational  models  based  on  biological  principles  must 
be  evaluated  through  experimentation  with  living  organisms.  Our  experimental  approach  is  based 
on  the  classically  conditioned  eye  blink/nictitating  membrane  response  (NMR)  of  the  rabbit,  which 
was  developed  originally  by  I.  Gormezano  in  the  1960s  and  has  been  employed  as  a  model  system 
in  scores  of  laboratories  around  the  world.  The  conditioned  eye  blink  is  a  temporally  adaptive 
form  of  behavior  because  it  anticipates  (predicts)  the  timing  of  the  reinforcing  event.  Our  principal 
concern  are  the  mechanisms  responsible  for  temporally  adaptive  conditioned  responding.  This 
work  enhances  the  scientific  underpinnings  of  research  on  adaptive  control  by  the  engineering  and 
computer  science  communities. 

Our  primary  experimental  approach  has  been  to  record  from  single  neurons  in  awake,  behaving 
animals  in  order  to  determine  the  loci  of  neurons  with  conditioning-related  activity  and  to  quanti¬ 
tate  the  relationship  of  this  activity  to  the  expression  of  the  conditioned  response.  Our  theoretical 
approach  has  been  to  extend  simple  computational  models  of  connectionist  learning  into  physio¬ 
logically  plausible  neural  networks  that  describe  real-time  features  of  conditioned  behavior.  These 
network  models,  and  their  possible  implementations  in  the  brain,  suggest  experimental  tests  and 
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provide  direction  for  physiological  studies. 

Research  Objectives 

One  goal  of  this  project  was  to  investigate  how  neural  systems  transform  temporal  expectations 
of  events  into  adaptive  behavior.  The  development  and  expression  of  temporal  expectations  is  basic 
to  understanding  complex  movements.  Such  movements  are  composed  of  simple  motor  responses 
that  are  appropriately  timed  and  executed.  One  ongoing  focus  of  research  has  been  to  characterize 
how  information  about  conditioned  stimuli  is  represented  in  brainstem  structures  (e.g.,  medial 
geniculates  and  pontine  nuclei)  that  are  afferent  to  putative  learning  sites  in  the  cerebellum. 

Status  of  Research 

The  following  is  an  overview  of  our  research  from  1983,  the  first  year  of  our  initial  AFOSR  grant. 

This  material  is  taken  from  my  competing  renewal  proposal  for  additional  support  submitted  last 
fall  (AFOSR  92-NL-033)  (A  list  of  all  published  accounts  of  work  during  this  period  appears  in 
Section  IV.) 

•  Reflex  pathway  Beginning  in  the  late  1970s,  Neil  Berthier  and  I  began  to  investigate  the 
neural  circuits  mediating  the  unconditioned  NMR.  Our  starting  point  was  the  work  of  Craig 
Cegavske,  Mike  Patterson,  and  others  working  with  Richard  Thompson,  showing  that  the 
NMR  is  mediated  by  the  abducens  (sixth)  nerve.  Berthier  and  Moore  (1980)  reported  that 
NM  extension  is  caused  by  eyeball  retraction,  and  that  this  retraction  involves  the  extraocular 
muscles,  especially  the  retractor  bulbi  muscles  which  are  innervated  by  motoneurons  of  the 
accessory  abducens  nucleus.  We  went  on  to  characterize  the  electrophysiology  of  the  reflex 
pathway  (Berthier  &  Moore  1983).  In  an  appended  report,  Muscle  activity  during  uncon¬ 
ditioned  and  conditioned  eye  blinks  in  the  rabbit,  Berthier  shows  that  the  NMR  is  tightly 
coupled  and  highly  correlated  in  time  with  the  activity  of  extraocular  muscles  and  that  this 
activity,  in  turn,  is  highly  correlated  with  the  eye  blink. 

•  Essential  circuits  for  the  CR  By  1980  it  was  clear  that  telencephalic  brain  structures 
(neocortex,  hippocampus,  basal  ganglia,  etc)  sure  not  essential  for  learning  or  generating 
conditioned  eye  blinks.  That  year,  John  Desmond  discovered  that  a  small  lesion  of  the  dor¬ 
solateral  pons  completely  eliminated  the  CR  while  leaving  intact  the  unconditioned  reflex 
(UR)  (Desmond  &  Moore  1982).  The  critical  structure  destroyed  by  such  lesions  was  the 
supratrigeminal  reticular  formation,  which  we  later  showed  projects  to  the  region  of  the  ac¬ 
cessory  abducens  nucleus  where  these  cells  could  participate  in  CR  output.  Shortly  thereafter, 
Thompson’s  group  at  Stanford  showed  that  lesions  of  the  cerebellar  deep  nuclei  produced  that 
same  pattern  of  CR  disruption  and  UR  sparing  observed  by  Desmond.  In  fact,  most  cases  of 
lesions  of  the  supratrigeminal  reticular  formation  that  resulted  in  CR  disruption  also  involved 
the  superior  cerebellar  peduncle  (brachium  conjunctivum)  and  were  therefore  interpretable 
in  terms  of  a  critical  role  of  the  cerebellum. 

•  Cerebellar  deep  nuclei  Chris  Yeo  and  his  associates  in  London  performed  lesion  studies 
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pinpointing  the  specific  cerebellar  nuclei  mediating  the  CR.  These  regions  are  the  anterior 
portion  of  nucleus  interpositus  (NIA)  and  the  medial  aspect  (dorsal  hump)  of  the  dentate. 
In  retrospect,  it  has  become  clear  that  the  essential  regions  of  the  cerebellum  for  CR  gener¬ 
ation,  cortex  and  deep  nuclei  alike,  are  those  associated  with  climbing  fiber  arising  from  the 
dorsal  accessory  olivary  nucleus,  the  portion  of  the  inferior  olive  dedicated  to  sensory-motor 
control  of  the  eyelids  and  periocular  tissue.  The  US  event,  its  parameter  features,  modality, 
and  point  of  application,  determines  the  specific  regions  of  the  cerebellum  involved  in  CR 
generation.  This  specificity  is  possible  because  of  the  highly  zonal  organization  of  climbing- 
fiber  projections  from  the  inferior  olive.  By  contrast,  information  about  a  potential  CSs  is 
‘broadcast’  throughout  neocerebellar  cortex  by  mossy  fibers.  If  synaptic  connections  are  al¬ 
tered  in  the  cerebellum  through  training,  it  is  the  US  which  instructs  the  system  where  these 
alterations  are  to  be  made.  These  findings  refined  the  preliminary  reports  from  Thompson’s 
lab,  and  they  have  been  confirmed  by  other  groups.  Recording  studies  support  the  idea  that 
the  motor  program  for  the  CR  exists  in  the  cerebellar  nuclei.  Berthier  conducted  a  single-unit 
study  of  cerebellar  nuclei  described  in  two  articles,  Activity  of  cerebellar  deep  nuclear  cells 
during  classical  conditioning  of  nictitating  membrane  extension  in  rabbits  (Berthier  &  Moore 
1990)  and  Linear  systems  analysis  of  the  relationship  between  firing  of  deep  cerebellar  neurons 
and  the  classically  conditioned  nictitating  membrane  response  in  rabbits  (Berthier  et  al  1991). 
These  articles  report  that  the  firing  of  cells  in  cerebellar  nucleus  interpositus  can  be  highly 
predictive  of  the  CR.  Anatomical  studies  of  cerebellar  nuclei  by  Marcy  Rosenfield  confirm 
previous  research  in  the  cat  and  rat:  (a)  interpositus  cells  project  to  the  red  nucleus,  (b) 
interpositus  cells  also  project  to  the  contralateral  inferior  olivary  nucleus,  (c)  the  interpositus 
nucleus  receive  afferents  from  cerebellar  (HVI)  Purkinje  cells  and  from  the  ipsilateral  lateral 
reticular  nucleus,  but  not  from  the  red  nucleus. 

•  Cerebellar  cortex  Lesion  studies  by  Yeo  and  his  colleagues  showed  that  the  production  of 
normal,  robust  CRs  requires  the  integrity  of  a  small  strip  of  cerebellar  cortex  associated  with 
innervation  of  the  eye — hemispheral  lobule  VI  of  Larsell  or  HVI  for  short.  Others  (Lavond  and 
Steinmetz)  have  painstakenly  confirmed  this.  Berthier  and  Moore  (1986)  reported  that  HVI 
Purkinje  cells  fire  in  a  maimer  that  predicts  the  CR.  The  foremost  open  question  is  whether 
Purkinje  cells  that  modulate  their  activity  in  relation  to  CRs  are  ‘trained’  by  US-triggered 
climbing  fiber  input,  as  would  be  required  by  theoretical  models  of  cerebellar  learning.  In 
addition  to  recording  studies,  Rosenfield  has  conducted  a  WGA-HRP  study  of  HVI  which 
confirms  previous  work  in  the  rabbit  by  Yeo  and  his  colleagues:  HVI  receives  bilateral  mossy- 
fiber  innervation  from  the  pontine  nuclei  and  spinal  trigeminal  pars  oralis.  It  also  receives 
climbing-fiber  innervation  from  the  contralateral  inferior  olive.  The  new  finding  is  that  HVI 
also  receives  a  sparse  mossy-fiber  projection  from  the  contralateral  red  nucleus.  This  observa¬ 
tion  has  potentially  significant  theoretical  implications  because  the  red  nucleus  is  a  candidate 
locus  of  the  ‘CR  Image’  posited  in  the  article,  Adaptively  timed  conditioned  responses  and  the 
cerebellum:  a  neural-network  approach  (Moore  et  al  1989). 

•  Red  nucleus  Red  nucleus  is  a  critical  structure  in  the  generation  of  the  CR  because  of 
its  projections  to  the  region  of  the  accessory  abducens  nucleus,  as  shown  by  HRP  studies, 
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and  its  innervation  by  the  cerebellum  via  brachium  conjunctivum.  Furthermore,  red  nucleus 
lesions  disrupt  CRs,  as  would  be  expected  if  the  motor  program  for  the  CR  is  routed  from  the 
cerebellum  to  motoneurons  via  this  link  (Rosenfield  &  Moore  1985).  Single-unit  recordings 
from  red  nucleus  during  CRs  revealed  the  presence  of  neurons  with  firing  patterns  related  to 
the  CR  production.  These  data  are  presented  in  the  article,  Single-unii  activity  in  red  nucleus 
during  the  classically  conditioned  rabbit  nictitating  membrane  response  (Desmond  &  Moore 
1991a).  The  same  study,  however,  suggests  that  red  nucleus  could  be  a  site  of  learning. 

•  Computational  models  In  1983,  we  began  to  develop  a  real-time  version  of  the  Sutton- 
Barto  (SB)  model  suitable  for  NMR  conditioning  (Moore  et  al  1986).  This  version  of  the 
model  has  been  described  in  several  reports,  e  g.,  the  articles  Conditioned  stimulus  duration 
in  classical  trace  conditioning:  test  of  a  real  time  model  (Blazis  &  Moore  1991).  In  order  to 
address  certain  limitations  of  the  SB  model,  Desmond  and  Moore  (1988)  developed  a  neural 
network  model  based  on  the  idea  that  time  is  represented  by  delay  lines.  The  Desmond-Moore 
(DM)  model  describes  real-time  aspects  of  CR  topography  for  both  simple  and  complex  train¬ 
ing  paradigms,  such  as  trace  conditioning.  The  model  assumes  that  CS  onset  and  CS  offset 
engage  separate  and  independent  input  elements.  These  input  elements  are  taps  off  of  delay 
lines  that  send  propagated  activity,  in  two  parallel  streams,  to  two  processing  nodes.  One 
node  updates  connection  weights  for  CR  output;  the  other  node  computes  the  expected  times 
of  occurrence  of  the  US.  The  DM  model  and  its  possible  implementation  in  the  brainstem 
and  cerebellum  are  described  in  the  article,  Adaptively  timed  conditioned  responses  and  the 
cerebellum,  a  neural  network  approach  (Moore  et  al  1989).  Although  it  accounts  for  motor 
output  in  the  context  of  classical  conditioning,  the  DM  model  can  be  regarded  as  general 
theory  of  temporally  adaptive  prediction  and  control. 

•  Tests  of  models  Our  modeling  work  has  relied  on  a  ‘top  down’  approach.  First,  we  instanti¬ 
ate  an  algorithmic  form  of  a  real-time  model  and  then  experimentally  investigate  its  properties 
in  simulation  studies.  This  process  has  suggested  possible  plausible  implementations  of  the 
model  in  the  brain,  as  illustrated  in  our  1989  article  on  the  DM  model.  One  prediction  of  the 
DM  model  concerns  the  response  waveforms  learned  in  trace  conditioning.  The  DM  model 
predicts  that  extending  the  OS’s  duration  can  result  in  bimodal  CR  waveforms,  with  each 
mode  or  peak  corresponding  to  the  point  where  the  US  occurs  with  respect  to  CS  onset  (the 
first  peak)  or  CS  offset  (the  second  peak).  These  results  are  described  in  the  article,  Altering 
the  synchrony  of  stimulus  trace  processes:  tests  of  a  neural-network  model  (Desmond  &  Moore 
1991b).  Other  tests  of  the  model  are  planned. 


Publications:  1983  to  Present 

Listed  here  in  chronological  order  are  all  publications  from  this  laboratory  from  1983  to  the 
present,  including  items  that  are  ‘in  press’  and  ‘submitted’.  It  is  not  an  exhaustive  list  of  all 
publications  by  the  PI  or  his  associates  during  this  period.  Support  for  this  work  came  from  the 
NSF  as  well  as  the  AFOSR.  Copies  of  the  most  recent  items,  not  previously  forwarded  to  AFOSR, 
are  appended  to  this  document. 
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•  Kevin  O’Connor,  Ph.  D.  (Psychology,  Columbia  University)  Postdoctoral  fellow.  O’Connor 
joined  the  laboratory  in  July,  1990. 

•  Marcy  E.  Rosenfield,  B.S.  (Zoology,  UMass)  Departmental  Assistant.  Rosenfield  is  a  certified 
AALAS  animal  care  technician. 


VI.  Interactions  (John  W.  Moore) 

Listed  here  or  Professional  Interactions  during  the  third  and  final  year  of  the  project.  Interac¬ 
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EMGs  were  recorded  from  the  orbicularis  oculi,  retractor  bulbi  and  superior  rectus  muscles  in  rabbits  to  investigate  the  time  course  of  muscle 
activation  during  unconditioned  and  conditioned  eye  blinks.  EMGs  from  the  three  muscles  showed  two  responses,  with  the  responses  of  the 
orbicularis  oculi  and  retractor  bulbi  showing  the  -  •  latency,  and  the  responses  of  the  superior  rectus  lagging.  The  latency  of  responses  to 
periorbital  electrostimulation  was  about  5  ms,  and  to  air  puff  stimulation  about  10  ms.  Results  showed  a  tight  coupling  of  activity  between 
muscles,  with  eross-eorrelograms  peaking  at  0.65  to  0.85  and  showing  little  time  shift.  Stimulus-response  curves  showed  clear  non-linearities 
in  the  response  of  the  musi  to  chances  in  stimulus  strength.  Local  anesthesia  of  the  cornea  had  little  effect  on  unconditionally  evoked 
responses.  The  form  of  unconditionally  evoked  responses  was  similar  with  periorbital  electrostimulation  and  air  puff  stimuli  but  differed  in 
latency.  These  results  show  the  form  of  t.  a  eye  blink  reflex  response  and  will  be  of  importance  in  interpreting  electrophysiological  studies  of 
the  classically  conditioned  eye  blink  of  rabbits. 


INTRODUCTION 

Stimulation  of  the  cornea,  periorbital  skin,  or  peri¬ 
orbital  hairs  of  the  rabbit  results  in  closure  of  the  eye¬ 
lids.  retraction  of  the  globe,  and  extension  of  the  nicti¬ 
tating  membrane  (NM).  These  movements  are  caused 
by  contraction  of  the  orbicularis  oculi  (00),  which  is 
internal  to  the  eyelids  and  causes  eyelid  closure,  and  by 
contractions  of  the  retractor  bulbi  (RB),  recti  and  infe¬ 
rior  oblique  extraocular  muscles  that  cause  retraction  of 
the  globe2-6-8.  Extension  of  the  NM  in  rabbit  passively 
results  from  retraction  of  the  globe  (e.g.  ref.  2).  Con¬ 
tractions  of  other  muscles  of  the  head  and  neck  fre¬ 
quently  accompany  defensive  eye  blinks. 

The  abduccns.  accessory  abducens,  facial,  and 
oculomotor  nuclei  contain  the  motoneurons  that  are 
responsible  for  the  defensive  eye  blink.  The  moto¬ 
neurons  that  control  the  00  are  located  in  the  facial 
nucleus  and  those  that  control  the  RB  during  defensive 
blinks  are  located  in  the  accessory  abducens  nucleus 
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(e.g.  refs.  3,5).  The  recti  and  oblique  muscles  that  con¬ 
tribute  to  defensive  blinking  are  innervated  by  the 
oculomotor  and  abducens  nuclei2-6-8. 

The  rabbit  eye  blink  is  used  as  a  model  system  in 
investigations  of  the  physiological  basis  of  classical 
conditioning.  These  studies  usually  record  the  position 
of  the  NM  as  an  index  of  the  unconditioned  (UR)  and 
conditioned  responses  (CRs).  Single-unit  recording 
studies  have  correlated  the  activity  of  central  neurons 
with  the  occurrence  and  performance  of  the  CR,  but 
neural  activity  is  usually  only  compared  to  NM  position 
(e.g.  ref.  4).  This  procedure  may  lead  to  overlooking 
some  eye  blink  neurons  that  are  not  correlated  with  NM 
position,  and  may  lead  to  labeling  neurons  as  projecting 
to  the  musculature  controlling  the  NM  when  in  fact  they 
project  to  the  external  lid  or  oculomotor  musculature. 
Currently,  little  data  is  available  on  the  time-course  of 
activation  of  the  various  muscles  underlying  the  blink  in 
rabbit.  Papers  on  cat10-18-19,  and  rabbit13  present 
recordings  from  either  the  00  or  RB.  Woody  and 
Engel20  compared  activity  of  the  levator  oris  and  00 
during  blinks  elicited  by  glabella  tap  in  cats. 
McCormick  etal.u  recorded  OO  EMG  concurrently 
with  NM  position  and  found  that  00  activity  was  only 
moderately  correlated  with  NM  position.  It  seems  likely 


that  a  higher  correlation  would  have  resulted  in 
McCormick  et  al.  if  00  and  RB  EMGs  were  compared 
directly. 

The  primary  purposes  of  the  present  paper  are  to 
investigate  the  time-course  of  muscle  activation  during 
conditioned  and  unconditioned  blinks  and  to  determine 
how  the  activity  of  the  eye  blink  musculature  is  inter¬ 
related.  To  achieve  these  aims  NM,  RB,  superior  rectus 
(SR)  EMGs,  and  NM  and  lid  positions  were  recorded 
during  unconditionally  elicited  blinks  as  well  as  during 
classical  conditioning  sessions.  The  SR  was  chosen 
because  it  is  likely  that  it  is  representative  of  the  extra¬ 
ocular  recti  muscles.  The  effects  of  changing  the 
strength,  duration,  and  modality  of  the  eliciting  stimuli 
were  investigated.  Because  of  the  technical  difficulties 
in  measuring  the  positions  of  the  external  lid  and  NM 
during  rapid  movements  such  as  blinks,  this  paper  does 
not  specifically  address  the  details  of  the  transformation 
of  muscle  activity  to  lid  and  NM  movement. 


MATERIALS  AND  METHODS 

EMGs  from  the  OO,  RB,  and  SR  were  obtained  from 
six  New  Zealand  albino  rabbits  during  classical  con¬ 
ditioning  sessions  and  during  unconditioned  blinks. 
NM  and  lid  positions  were  recorded  with  minitorque 
potentiometers  along  with  EMG  recordings.  Three  rab¬ 
bits  were  prepared  for  chronic  recording  and  three  rab¬ 
bits  were  used  as  acute  preparations. 

Implantations  of  EMG  electrodes  were  done  in  gen¬ 
erally  anesthetized  animals.  Chronic  animals  were 
anesthetized  with  a  mixture  of  ketamine  (35  mg/kg), 
acepromazine  (0.3  mg/kg),  and  xylazine  (5  mg/kg),  and 
acute  animals  were  anesthetized  with  sodium  pentothal 
(to  effect).  Xylocaine  was  injected  into  wound  margins, 
subconjunctively,  and  on  the  cornea  after  induction  of 
general  anesthesia.  Single-stranded  Teflon-coated 
stainless  steel  wires  (0.003  inch  bare;  0.0045  inch 
coated)  were  used  as  EMG  electrodes.  Each  electrode 
was  prepared  by  placing  a  length  of  wire  in  a  27-gauge 
hypodermic  needle,  stripping  1  mm  of  insulation  from 
the  end  of  the  wire,  and  bending  the  wire  to  form  a  hook. 
The  wire  was  then  pulled  back  through  the  needle  until 
only  the  hook  was  exposed.  The  wire  was  then  placed 
into  the  muscle  and  the  needle  removed.  A  pair  of  wires 
was  placed  into  each  of  the  muscles.  All  animals  had 
EMG  electrodes  placed  in  the  OO,  RB,  and  SR 
muscles.  In  chronic  animals  wires  were  run  subcutane¬ 
ously  to  a  connector  that  was  fixed  to  the  top  of  the  head 
with  dental  cement.  In  acute  animals  the  wires  were  run 
subcutaneously  to  a  location  on  the  top  of  the  head  and 
then  attached  directly  to  the  input  stage  of  a 


preamplifier.  During  surgery  a  boll  was  also  attached  to 
the  skull  so  that  the  head  could  be  rigidly  held  during 
the  recording  sessions4.  Animals  were  then  allowed  to 
recover  from  the  general  anesthetic. 

NM  position  was  measured  by  a  potentiometer  that 
was  rigidly  connected  to  the  NMJ.  Eyelid  position  was 
measured  by  a  potentiometer  that  was  rigidly  connected 
to  the  upper  eyelid.  The  rigid  connection  from  the  lid 
and  NM  to  the  potentiometers  was  fashioned  from 
lengths  of  30-gauge  stainless  steel  tubing.  The  tubing 
was  connected  to  the  lid  and  N M  via  a  short  loop  of  4-0 
nylon  suture.  Because  the  primary  purpose  of  this  inves¬ 
tigation  was  the  recording  of  EMGs  and  because  of 
mechanical  constraints  of  the  apparatus,  the  poten¬ 
tiometers  could  not  be  placed  optimally.  This  led  to 
smaller  potentiometer  rotations  and  smaller  voltage 
signals  from  lid  and  NM  movements  than  is  normal  for 
behavioral  experiments.  These  smaller  potentiometer 
signals  were  also  less  reliable  than  usual  and  did  not 
always  accurately  reflect  lid  and  NM  movements.  On 
many  occasions,  the  potentiometer  signals  did  appear 
to  accurately  reflect  the  latency  and  amplitude  of  NM 
and  lid  movement  when  compared  to  blinks  measured 
in  other  studies  using  conventional  methods  in  the  same 
laboratory  (e.g.  ref.  4). 

EMG  activity  was  amplified,  band-passed  at 
10-3,000  Hz,  displayed  on  an  oscilloscope,  and  recorc 
ed  on  a  tape  recorder  for  off-line  analysis.  EMG  activity 
was  also  full-wave  rectified  and  integrated  with  a  time 
constant  of  7.5  ms.  For  off-line  analysis,  integrated 
EMG  and  position  data  were  8-bit  A/D  converted  at 
200  Hz.  Data  were  stored  on  disk  and  displayed  on  a 
graphics  terminal.  Cross-corrclograms  were  computed 
between  the  rectified,  integrated  EMGs  with  the  cross¬ 
correlation  at  time-shift  j  equalling12: 

r(j)_  Z  [*,-/-*]  [y,-y) 

Z  Z  [y-y?  ' 

where  .v  and  y  are  the  sequences  of  samples  from  the 
integrated  EMGs  of  two  different  muscles,  T  and  y  are 
the  means  of  the  two  samples,  and  j  is  the  time  shift. 
Time  shifts  were  computed  from  -  100  to  100  ms  in 
steps  of  5  ms. 

Unconditioned  stimuli  used  to  elicit  eye  blinks  were 
electrical  stimulation  of  the  periorbital  skin  and  air 
puffs.  Electrostimulation  of  the  periorbital  skin  was 
performed  as  in  conditioning  experiments  (e.g.  ref.  4). 
Briefly,  two  9-mm  wound  clips  were  placed  in  the  skin 
at  the  temporal  canthus  and  just  inferior  to  the  eye. 
Electrical  stimuli  delivered  to  the  periorbital  skin  were 
generated  by  a  Grass  S88  stimulator  and  isolated  with 


a  Grass  PS1U  5  stimulus  isolation  and  constant  current 
unit. 

A  cylinder  of  compressed  nitrogen  was  used  as  a 
source  for  the  air  puffs.  The  gas  was  regulated  at  the 
tank  (1-20  psi)  and  delivered  in  pulses  of  30-300  ms 
duration.  Pulse  duration  was  controlled  by  a  solenoid. 
The  exit  port  of  the  valve  (3  mm  in  diameter)  was 
directed  at  the  cornea  and  placed  1-2  cm  from  the 
cornea.  A  miniature  microphone  was  placed  just  above 
the  eye  to  measure  when  the  puff  reached  the  cornea. 
The  exit  port-cornea  distance  was  the  same  as  the  exit 
port-microphone  distance.  The  output  of  the  micro¬ 
phone  also  provided  a  measure  of  the  duration  of  the 
puff. 

Classical  conditioning  trials  were  given  with  a 
1.200  Hz  tone  as  the  CS,  and  electrical  stimulation  of 
the  periorbital  skin  as  the  US.  The  intcrstimulus  inter¬ 
val  was  350  ms  for  some  animals  and  500  ms  for  others. 
The  CS  and  the  US  co-terminated.  The  US  consisted 
of  a  series  of  two  0.1  ms  duration  pulses  of  electro¬ 
stimulation  at  an  interpulse  interval  of  7  ms.  The  inter¬ 
trial  interval  was  30  s.  Details  of  classical  conditioning 
procedures  can  be  found  in  ref.  9. 

RESULTS 

Recordings  from  chronic  and  acute  animals  were 
very  similar  in  latency  and  form.  The  data  on  which  the 
Figures  of  the  current  paper  are  based  are  taken  from 
acute  recordings  because  the  signal-to-noisc  ratio  and 
reliability  of  the  EMGs  were  generally  higher  in  the 
acute  animals. 

Unconditioned  response 

Eye  blinks  elicited  by  air  puffs  and  periorbital  elec¬ 
trostimulation  were  of  different  latency  but  otherwise 
similar  in  time-course.  Fig.  1  shows  typical  examples  of 
the  OO,  RB,  and  SR  EMG  responses  to  air  puff 
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l:ii!.  I  RB.  SR.  a nd  OO  EMG  responses  to  periorbital  stimulation. 
The  responses  arc  raw  and  not  integrated  EMGs.  Rl  is  indicated  by 
the  asterisk  and  R2  is  indicated  by  the  hatched  bar  A:  EMG 
responses  to  air  pufT  stimulation.  The  timing  of  the  air  puff  is  shown 
b>  the  lower  tract.  B:  EMG  response  to  electrostimulation  of  the 
periorbital  skin  Onset  of  the  stimulus  is  indicated  by  the  arrow. 


(Panel  A)  and  periorbital  electrostimulation  (Panel  B). 
Panel  A  shows  air  puff-elicited  responses,  and  Panel  B 
shows  electrostimulation-elicited  responses.  The  stimu¬ 
lus  artifact  with  air  puff  stimuli,  unlike  electrostimu¬ 
lation  stimuli,  was  usually  too  small  to  be  noticed  in 
recordings  of  normal  gain  and  did  not  contaminate 
integrated  EMGs.  The  stimulus  artifact  of  periorbital 
electrostimulation  did  lead  to  significant  contamination 
of  the  EMG,  but  neural  responses  could  be  separated 
from  artifact  by  comparing  recordings  with  opposite 
stimulus  polarity.  OO  and  RB  EMG  responses  were 
always  much  greater  in  amplitude  than  SR  EMG 
responses.  Examination  of  EMGs  revealed  short- 
latency  and  long-latency  responses  to  the  eliciting  sti¬ 
muli  in  each  of  the  muscles.  These  responses  are  usually 
called  the  early  response  (Rl)  and  late  response  (R2) 
(c.g.  ref.  7).  In  Fig.  1  Rl  is  indicated  by  the  asterisk  and 
R2  by  the  hatched  bar. 

Latencies  of  Rl  and  R2  were  measured  from  photo¬ 
graphs  or  directly  from  the  oscilloscope.  The  latency  of 
the  Rl  was  very  reliable  once  the  eliciting  stimulus  was 
significantly  above  threshold,  while  the  latency  of  R2 
was  harder  to  measure  and  seemed  more  variable 
because  of  the  unsynchronized  nature  of  the  motor  unit 
activity.  The  latencies  of  the  responses  did  vary  with  the 
type  of  eliciting  stimulus.  Periorbital  electrostimulation 
resulted  in  shorter  latency  EMG  responses  than  air 
puffs.  Air  puffs  elicited  Rl  and  R2  responses  at  about 
10  and  15  ms  latency  (e.g.  Fig.  1A),  while  electrostimu¬ 
lation  produced  responses  at  about  5  and  10  ms  latency 
(e.g.  Fig.  IB).  Regardless  of  the  eliciting  stimulus,  the 
Rl  response  appeared  to  be  a  relatively  synchronous 
volley,  while  the  R2  response  appeared  to  be  the  result 
of  a  longer  period  of  unsynchronized  activity.  In  a  given 
animal,  the  RB  and  OO  EMGs  responses  became  acti¬ 
vated  at  slightly  different  times,  with  neither  muscle 
being  consistently  activated  before  the  other  across  ani¬ 
mals.  The  difference  in  time  between  the  activation  of 
the  RB  and  OO  was  always  less  than  1  ms.  The  SR 
response  always  lagged  behind  the  RB  and  OO 
responses. 

Effects  of  stimulus  amplitude  and  duration 

In  order  to  investigate  how  the  unconditioned  reflex 
transforms  the  eliciting  stimulus  into  an  eye  blink,  air 
puff  stimuli  of  differing  amplitude  and  duration  were 
presented  to  three  animals.  Air  puffs  were  used  to  avoid 
the  electrical  artifacts  introduced  by  electrostimulation. 
Each  combination  of  intensity  and  duration  was  given 
10  times  and  the  resulting  rectified  EMG  responses  for 
each  combination  were  averaged  together.  Fig.  2  shows 
the  results  for  one  of  the  animals  that  are  representative 
of  the  three  animals.  Panel  A  shows  responses  to  an  8 
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lis.  2.  Average  responses  to  8  (A),  12  (B),  anil  16  (C)  PSI  air  puffs.  The  traces  from  lop  to  bottom  show  the  time  course  of  the  stimulus.  NM 
position,  and  SR.  RB.  and  OO  rectified  EMG  activity.  The  dotted  traces  are  the  responses  to  30-ms  stimuli,  the  dashed  traces  responses  to 
45-ms  stimuli,  and  the  solid  traces  the  responses  to  80-ms  stimuli.  The  onset  of  the  air  puff  is  indicated  by  the  vertical  dotted  iine.  The  combined 
Rl.  R2  response  is  indicated  by  the  open  circle,  and  the  long-latency  response  is  indicated  by  the  filled  circle. 


PSI  stimulus,  Panel  B  to  a  12  PSI  stimulus,  and  Panel  C 
to  a  16  PSI  stimulus.  Stimulus  durations  of  30,  45  and 
80  ms  are  shown  in  each  of  the  panels. 

Fig.  2  shows  that  the  NM  response  lengthened  with 
stimulus  duration,  with  stimuli  of  80  ms  duration  result¬ 
ing  in  a  long,  step-like  response.  NM  position  required 
2-8  s  to  return  to  baseline  after  termination  of  the  sti¬ 
mulus.  EMG  activity  was  at  a  very  low  level  during  the 
decay  of  NM  extension. 

The  Rl  and  R2  responses  are  not  easily  separated  in 
Fig.  2  because  the  EMGs  are  rectified,  integrated,  and 
averaged.  The  combined  Rl,  R2  complex  is  indicated 
by  the  open  circle.  A  long-latency  EMG  volley,  with  a 
latency  of  about  70  ms,  is  visible  in  the  data  from  the 
80-ms  duration  stimuli  (filled  circle).  The  long-latency 
EMG  volley  was  not  the  R2  volley  described  above,  as 
the  latency  of  the  long-latency  volley  was  significantly 
longer  than  the  R2  response  in  the  EMG.  Stimulus 
durations  of  30  and  45  ms  did  not  elicit  the  long-latency 
volley,  whereas  stimulus  durations  of  greater  than 
80  ms  invariably  elicited  a  long-latency  volley.  Exami¬ 
nation  of  data  from  other  animals  indicated  that  a  sti¬ 
mulus  duration  of  50  ms  was  sufficient  to  elicit  the 
long-latency  volley.  In  Fig.  2  the  long-latency  response 
is  seen  in  all  three  panels  and  in  all  three  muscles  when 
stimulus  duration  was  80  ms. 

Fig.  2  also  shows  that  there  was  a  rapid  transition 
from  small  to  large  amplitude  NM  extensions  when 
stimulus  strength  was  increased.  With  all  stimulus  dura¬ 
tions  shown  in  Panel  A  and  with  the  shortest  duration 
stimulus  of  Panel  B,  NM  extension  is  small,  whereas  in 
Panel  C  and  in  Panel  B’s  two  other  traces,  NM  exten¬ 
sion  is  large. 


Amplitude  of  the  First  Response 


Stimulus  Intensity  (PSI) 

Fig.  3.  Amplitude  of  the  first  response  in  the  RB  and  OO  muscles 
to  air  puff  stimuli  of  8,  12,  and  16  PSI.  The  dotted  lines  are  the 
response  to  30-ms  stimuli,  the  dashed  lines  are  the  response  to 
45-ms  stimuli,  and  the  solid  lines  are  the  response  to  80-ms  stimuli. 
The  amplitude  is  scaled  so  that  the  response  to  the  strongest  stimu¬ 
lus  is  100%. 


Fig.  3  shows  the  amplitude  of  the  initial  EMG 
response  (i.e.  the  one  indicated  by  the  open  circle  in 
Fig.  2)  as  a  function  of  stimulus  intensity  and  duration 
for  a  single  representative  animal.  Each  data  point) 
shows  the  average  amplitude  of  the  initial  EMG  peak; 
from  a  series  of  10  presentations.  The  responses  of  RB1 
for  stimuli  of  varying  intensity  and  duration  are  shown 
by  the  filled  squares.  Only  the  RB  responses  to  the 
45-ms  duration  stimuli  resemble  a  linear  stimulus-' 
response  curve.  The  other  responses  seem  significantly 
non-linear;  changes  in  response  intensity  when  the  sti- 


mulus  was  weak  only  had  small  effects  on  response 
amplitude,  changes  of  stimulus  intensity  with  a  strong 
stimulus  similarly  had  small  effects  on  stimulus  ampli¬ 
tude.  When  the  stimulus  was  of  moderate  intensity, 
changes  in  intensity  had  a  large  effect  on  response 
amplitude. 

This  same  general  pattern  shown  by  the  RB  was 
repeated  for  the  stimulus-response  curve  of  the  00. 
The  activity  of  the  SR  was  an  order  of  magnitude  less 
and  changes  in  the  size  SR  EMG  were  small  when  the 
amplitude  or  duration  of  the  eliciting  stimulus  was 
varied. 

Experiments  where  the  strength  of  the  stimulus  was 
lowered  showed  that  threshold  intensities  for  EMG 
responses  in  00  and  RB  were  identical.  However, 
Fig.  3  shows  that  activity  in  00  was  closer  to  maximal 
at  low  intensities  than  RB.  With  the  8  PSI  stimulus,  RB 
responded  with  an  amplitude  that  was  28-36%  maxi¬ 
mal,  the  OO  at  66%  maximal.  This  illustrates  that  OO 
activity  recruited  earlier  and  saturated  at  a  lower  stimu¬ 
lus  level  than  RB. 

Effect  of  head  tilt  on  EMG  activity 

In  order  to  confirm  that  the  low  amplitude  SR 
recordings  were  indeed  from  the  SR  and  not  a  neigh¬ 
boring  muscle,  and  to  investigate  how  the  EMG  blink 
responses  change  with  different  starting  positions  of  the 
globe,  we  recorded  EMGs  during  blinks  with  the  head 
of  the  animal  fixed  at  different  angles  of  roll.  At  different 
angles  of  roll,  the  SR  was  tonically  activated  to 
maintain  the  visual  streak  of  the  retina  in  line  with  the 
horizon.  Fig.  4  shows  the  EMGs  in  a  typical  experiment 
where  the  animal  was  rolled  to  20°  from  horizontal. 
Panel  A  shows  the  air  puff  evoked  EMGs  when  the 
head  was  level,  and  Panel  B  shows  the  evoked  EMGs 
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Fig.  4.  Effect  of  head  tilt  on  eye  blink  EMGs.  The  left  panel  shows 
activity  with  the  head  level,  and  the  right  shows  activity  with  the 
head  at  20°  of  roll. 

when  the  head  was  rolled.  Fig.  4B  shows  that  SR  EMG 
was  tonically  active  when  the  head  was  tilted. 

A  small  increase  in  RB  tonic  activity  could  also  be 
discerned  when  the  head  was  rolled  (not  shown).  This 
was  expected  sine  the  RB  electrodes  were  in  the  dorsal 
area  of  the  muscle  and  its  activity  would  presumably 
increase  with  globe  rotation.  These  results  show  that 
tonic  SR  activity  could  be  recorded  when  expected,  and 
that  the  tonically  active  SR  motor  units  were  similar  in 
amplitude  to  the  motor  units  that  responded  to  air  puff 
stimulation.  It  is  likely,  that  the  SR  EMG  activity 
recorded  to  blink  eliciting  stimuli  was  the  result  of  SR 
activity  and  not  the  result  of  activity  of  neighboring 
muscles. 

Cross-correlations  between  muscles 

In  three  different  animals,  a  series  of  stimuli  were 
presented  of  varying  duration  and  intensity.  The  goal 
was  to  elicit  a  series  of  eye  blinks  of  a  variety  of  ampli¬ 
tudes  and  durations.  Cross-correlations  were  then  com¬ 
puted  between  the  OO  and  RB,  OO  and  SR,  and  RB 
and  SR  rectified,  integrated  EMGs.  Fig.  5  shows  these 
correlations  for  a  series  of  air  puff  presentations.  The 
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Fig  5.  Cross-correlograms  of  RB,  00,  and  SR  muscle  activity  to  air  puffs.  From  left  to  right  are  RB-OO,  RB-SR,  and  SR-OO  cross- 

correlograms.  The  responses  shown  are  averages  of  data  from  10  trials. 


26 


peak  correlation  for  Panel  A  was  0.82,  Panel  B  0.62, 
and  Panel  C  0.69.  The  greatest  peak  shift  of  a  cross- 
correlogram  from  the  three  animals  was  10  ms. 

These  results  indicate  that  the  integrated  EMG  of  the 
three  muscles  was  highly  correlated,  with  minimal  time 
shift  between  muscles.  The  high  correlations  seen  in  the 
cross-correlograms  of  integrated  EMGs  seem  primarily 
to  reflect  similarity  in  the  peaks,  onsets,  and  shapes  of 
the  EMGs.  Examination  of  the  raw  data  indicated  two 
reasons  why  the  peak  correlations  were  not  higher.  The 
first  is  that  the  OO  showed  spontaneous  activity  and  a 
much  slower  return  to  baseline,  while  the  RB  and  SR 
showed  little  spontaneous  activity  and  a  rapid  return  to 
baseline.  The  second  reason  is  that  SR  activity  was 
significantly  lower  in  amplitude,  and  manipulations  of 
stimulus  intensity  and  duration  had  less  effect  on  the 
SR  EMG  than  the  OO  and  RB  EMGs  (cf.  Fig.  1). 

Effect  of  Xylocaine  to  the  cornea 

In  order  to  determine  the  contribution  of  corneal 
afferents  to  the  unconditioned  reflex  we  examined  US- 
evoked  EMGs  before  and  after  saturation  of  the  cornea 
with  1  %  Xylocainc.  Adequate  anesthesia  of  the  cornea 
was  confirmed  by  the  lack  of  reflex  responses  to  touches 
of  the  cornea  with  a  probe.  The  present  results  did  not 
depend  on  whether  air  puff  or  electrostimulation  of  the 
periorbital  skin  was  used  as  the  eliciting  stimulus.  Fig.  6 
shows  data  from  air  puff  elicited  blinks  because  of  the 
lack  of  stimulus  artifact  with  the  air  puff.  The  responses 
of  the  RB,  OO,  and  SR  muscles,  as  well  as  the  NM 
position,  before  and  after  local  anesthesia  of  the  cornea 
are  shown.  Ten  stimulus  presentations  were  given  fol- 


Fig.  6.  Eye  blink  before  and  after  application  of  Xylocaine  to  the 
cornea.  The  solid  trace  shows  th  response  before  and  the  dotted 
trace  the  response  after  Xylocaine  application.  The  responses 
shown  arc  averages  of  data  from  10  trials.  The  air  puff  was  30  ms 
in  duration  and  its  application  did  not  cause  a  visible  stimulus 
artifact  in  the  integrated  EMGs. 
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Fig.  7.  Multiphasic  CRs  during  conditioning.  Recording  from  two 
trials  arc  shown.  From  top  to  bottom:  CS  and  US  timing.  NM 
position,  lid  position,  OO,  RB,  SR  EMG  records.  Note  the  high 
correlation  of  activity  across  muscles. 

lowed  by  saturation  of  the  cornea  with  Xylocaine.  After 
waiting  5-10  minutes,  ten  stimulus  presentations  were 
given  of  the  same  amplitude  and  duration.  Fig.  6  shows 
the  averaged  integrated  EMGs  from  each  series  of  pres¬ 
entations.  As  can  be  seen,  the  eye  blink  EMGs  were 
little  effected  by  the  Xylocaine. 

EM G  activity  during  conditioning 

EMG  activity  of  the  OO,  RB,  and  SR  was  highly 
cross-correlated  during  conditioning  sessions.  Fig.  7 
shows  EMGs  recorded  during  a  conditioning  trial. 
These  CRs  are  atypical  in  that  they  were  multi-peaked. 
but  they  illustrate  the  tight  coupling  of  EMG  activity 
between  muscles.  Examination  of  the  EMGs  shows 
that  a  burst  in  one  muscle  was  invariably  accompanied 
by  bursts  in  other  muscles.  Most  of  the  EMG  bursts 
were  followed  by  inflections  in  the  NM  position  trace. 

Cross-correlograms  were  computed  for  the  EMGs 
obtained  during  conditioning  sessions.  Fig.  8  shows 
three  correlograms  for  OO-RB,  OO-SR,  RB-SR 
muscles.  The  correlograms  typically  peaked  at 
0.65-0.85  with  time  shifts  of  less  than  10  ms. 


DISCUSSION 

The  results  of  this  experiment  show  that  the  SR,  RB, 
and  OO  are  all  involved  in  the  rabbit  eye  blink.  EMG 
activity  in  the  OO  and  RB  was  very  similar  in  threshold, 
timing  and  amplitude,  while  EMG  activity  in  the  SR 
was  an  order  of  magnitude  smaller.  As  shown  by  earlier 
investigators"-16,  the  latency  of  R1  is  very  reliable.  The 
activity  of  the  three  muscles  was  highly  correlated  dur¬ 
ing  both  conditioned  and  unconditioned  blinks.  The 
finding  that  EMG  activity  was  highly  correlated  during 
blinks  was  somewhat  surprising  because  the  muscles 
control  two  systems,  the  eyelid  and  the  globe,  that  are 
not  directly  coupled.  One  might  expect  that  a  coordi¬ 
nated  blink  would  require  the  globe  to  be  retracted 
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Fig.  S.  Cross-corrclograms  of  RB.OO,  and  SR  muscle  activity  during  classical  conditioning.  The  panels  from  left  to  right  show  RB-OO.  RB-SR, 

and  SR-00  cross-correlograms. 


before  the  closure  of  the  lids  (or  vice  versa).  A  second 
factor  that  would  degrade  the  cross-correlations 
between  muscles  is  the  fact  that  the  biophysical  prop¬ 
erties  of  the  blink  muscles  differ  significantly.  For 
example,  Steinacker  and  Bach-y-Rita17  showed  that 
while  the  recti  and  oblique  muscles  contain  both  fast 
twitch  and  tonic  fibers,  the  RB  contains  mainly  a  single 
intermediate  speed  fiber  type.  Consistent  with  the  lack 
of  RB  tonic  fibers  was  the  result  that  the  OO  showed 
more  tonic  activity  than  the  RB  and  SR. 

The  results  of  the  present  study  and  others  provide 
a  good  estimate  of  the  time  sequence  of  activity  during 
the  blink  reflex  in  cats  and  rabbits.  One  complicating 
factor  is  the  eliciting  stimulus:  studies  using  air  puff 
from  different  laboratories  show  an  inconsistency  of 
latencies  primarily  because  of  the  difficulties  in  con¬ 
trolling  and  assessing  the  air  puff.  Studies  using  peri¬ 
orbital  electrostimulation  or  electrical  stimulation  of  the 
trigeminal  system  show  more  consistent  timing  across 
laboratories.  Berthier  and  Moore3  showed  that  RB 
motoneurons  respond  at  about  4.5  ms  latency  to 
periorbital  electrostimulation.  The  R1  latency  in  the 
present  paper  was  about  5  ms,  and  in  cats  about 
5  ms10'"1.  Quinn  et  al.15  recorded  the  shortest  latency 
globe  retractions  at  9.3  ms.  Stimulation  of  the  trigemi¬ 
nal  nerve  near  its  entrance  to  the  brainstem  causes  an 
eye  retraction  with  5.3  ms  latency3.  These  figures  from 
different  studies  involving  cats  and  rabbits  arc  con¬ 
sistent  within  about  a  millisecond,  and  show  that  the 
reflex  is  very  rapid  with  the  bulk  of  the  time  required  to 
convert  the  EMG  activity  to  movement  of  the  globe 
(about  4-5  ms).  The  timing  for  electrical  trigeminal 
stimulation  extrapolates  to  air  puff  stimulation  if  one 
assumes  that  significant  time  is  required  for  the  air  puff 
to  cause  discharge  of  trigeminal  sensory  neurons. 

The  current  results  show  that  the  blink  is  the  result 


of  coordinated  action  of  several  muscles.  The  UR  is 
very  reliable  and  consistent  from  trial  to  trial  when  the 
duration  and  amplitude  of  the  eliciting  stimulus  is  con¬ 
stant.  Transmission  in  the  UR  pathway  is  subject  to 
modulation  as  shown  by  reflex  modulation  experiments 
(e.g.  ref.  7).  The  high  degree  of  coupling  of  the  blink 
muscles  observed  in  the  present  experiment  suggests 
that  a  single  neural  center  may  be  responsible  for 
generating  the  reflex  response.  However,  the  present 
results  do  not  rule  out  the  possibility  that  the  tight 
coupling  may  be  the  result  of  parallel  activity  in  several 
pathways  that  is  synchronized  by  the  US. 

The  response  of  the  eye  blink  muscles  to  stimuli  of 
various  intensities  and  durations  showed  pronounced 
non-linearities.  At  low  or  high  levels  of  stimulation, 
changes  in  stimulus  intensity  or  duration  had  little  effect 
on  EMG  responses.  At  moderate  levels  of  stimulation, 
changes  in  stimulus  strength  resulted  in  large  changes 
in  the  EMG  response.  This  type  of  stimulus-response 
function  suggests  that  there  is  an  intermediate  value  of 
stimulus  strength  below  which  EMG  responses  are 
small,  but  above  which  EMG  responses  are  large  or 
‘full-blown’.  The  stimulus-response  functions  for  the 
RB  and  OO  were  very  similar,  but  the  OO  reached  a 
maximal  amplitude  at  a  lower  stimulus  strength  than  the 
RB.  Underlying  the  narrow  region  of  the  stimulus- 
response  function  where  amplitude  modulation  is  possi¬ 
ble  may  be  the  high  innervation  ratio  of  the  muscles 
used  for  the  blink.  For  example,  Steinacker  and  Bach-y- 
Rita17  showed  that  the  innervation  ratio  of  the  RB  was 
50  to  1,  a  value  that  would  be  incompatible  with  fine 
control  of  muscle  tension. 

The  blink  response  seems  to  be  primarily  initiated  by 
periorbital  skin  and  hair  receptors,  and  not  by  corneal 
afferents,  because  anesthesia  of  the  corneal  receptors 
had  little  noticeable  effect  on  the  amplitude  or  time- 


28 


course  of  the  elicited  blink.  In  humans,  Rushworth16 
showed,  and  Beradelli  etal.1  confirmed,  that  corneal 
stimulation  alone  elicits  an  EMG  response  at  a  latency 
of  30-40  ms,  a  result  that  strongly  suggests  that  corneal 
alTercnls  are  not  involved  in  Rl.  One  limitation  of  the 
current  study  is  that  the  corneal  anesthesia  experiment 
was  not  performed  while  systematically  varying  the  sti¬ 
mulus  magnitude  and  duration.  It  is  possible  that 
corneal  anesthesia  might  have  a  disccrnable  effect  at  a 
particular  stimulus  strength.  These  observations  do  not 
preclude  a  significant  role  for  corneal  receptors  in 
modulating  the  blink,  particularly  during  conditioning 
where  a  strong  nociceptive  input  from  corneal  receptors 
may  enhance  conditioning.  In  fact,  preliminary  data 
from  this  laboratory  suggests  that  eliciting  a  strong 
EMG  response  in  the  blink  musculature  is  not  always 
sufficient  to  support  conditioning. 
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Rabbits  were  trained  on  a  Pavlovian  conditioned  inhibition  (Cl)  task  using  light  as  the  reinforced  conditioned  stimulus  (CS  +  )  and  the  same 
light  compounded  with  a  tone  as  the  nonreinforced  CS  -  .  The  conditioned  response  was  the  nictitating  membrane  response.  After  attaining 
a  criterion  of  Cl  performance,  animals  received  radio-frequency  lesions  of  the  hypothalamus  (n  =  1 1 )  or  midbrain  (n  =  1 4).  For  the  hypothalamic 
lesion  cases,  primary  damage  extended  from  the  optic  chiasm  to  the  pretectal  region.  For  the  mesencephalic  lesion  cases,  primary  damage 
ranged  from  the  most  rostral  portions  of  the  periaqueductal  grey  (PAG)  caudally  to  the  tegmental  reticular  formation  at  the  level  of  the  third 
nerve.  Prior  research  suggested  that  the  hypothalamic  lesions  would  disrupt  retention  of  Cl  by  increasing  responding  to  the  CS  -  .  Except  where 
a  lesion  impinged  upon  the  zona  incerta,  no  Cl  disruption  was  observed.  In  accordance  with  previous  studies  (Berthier,  N.E.  and  Moore,  J.W., 
Physiol.  Behav.,  25  (1980)  667-673;  Mis,  F.W.,  J.  Comp.  Physiol.  Psychol.,  91  (1977)  975-988),  post-lesioning  Cl  disruption  was  observed  in 
some  of  the  mesencephalic  lesion  cases  involving  the  posterior  commissure,  PAG  and/or  accessory  oculomotor  nuclei.  However,  Cl 
performance  recovered  over  the  course  of  retraining. 


INTRODUCTION 

Pavlovian  conditioned  '"hibition  (Cl)  has  proven  to 
he  a  powerful  tool  in  the  investigation  of  response  sup¬ 
pression  in  learning  and  memory19.  In  Cl  training,  an 
animal  is  presented  with  a  conditioned  stimulus  (CS  +  ), 
for  example,  a  light  (L),  that  is  always  paired  with  an 
unconditioned  stimulus  (US).  On  other  trials,  L  is  pres¬ 
ented  together  with  another  CS,  for  example,  a  tone  (T), 
that  is  the  conditioned  inhibitor.  The  LT  compound 
(CS  -  )  is  never  paired  with  the  US.  Animals  typically 
learn  to  perform  conditioned  responses  (CRs)  to  L  and 
to  suppress  CRs  to  the  LT  compound.  Unlike  simpler 
forms  of  differential  conditioning,  the  Cl  paradigm 
requires  that  the  animal  attends  fully  to  the  stimuli 
presented.  Differential  conditioned  responding  would 
not  be  possible  otherwise.  A  brain  lesion  that  selectively 
disrupts  Cl  would  manifest  itself  as  an  elevated  level  of 
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conditioned  responding  during  CS  -  trials  with  no  loss 
of  responding  to  CS  +  . 

The  rabbit  nictitating  membrane  response  (NMR) 
preparation  has  been  useful  in  the  investigation  of 

1 ,2.17,1 8,20.2 1 ,23,28,33^  but,  (jespjte  recent  gain  s  in  under¬ 
standing  the  neural  substrates  of  the  conditioned 
NMR12-32,  lesion  studies  have  not  yet  indicated  the 
neural  structures  essential  for  the  expression  of  Cl  in 
this  preparation.  Although  the  frontal  neocortex  was 
once  regarded  as  essential  for  learned  inhibition3-4-9, 
decorticated  rabbits  can  acquire  and  perform  Cl23.  Fur¬ 
thermore,  if  rabbits  acquire  Cl  and  then  undergo  decor¬ 
tication,  they  reacquire  Cl  faster  than  controls33.  Nota¬ 
bly,  decorticates  showed  an  initial  impairment  of  Cl 
retention,  when  compared  to  sham-operated  controls, 
but  this  initial  disruption  was  transitory.  Related 
studies  have  failed  to  implicate  the  hippocampal  for¬ 
mation  in  Cl  of  the  conditioned  NMR28.  Lesions  of 
certain  midbrain  structures,  however,  have  been  report¬ 
ed  to  interfere  with  Cl'-20. 

Berthier  and  Moore1  observed  disruption  of  previ¬ 
ously  acquired  Cl  of  the  NMR  following  lesions  of  the 
periaqueductal  grey  (PAG)  and  the  pretectum-posterior 
commissure  region.  Degenerating  fibers  resulting  from 


72 


these  lesions  (Fink-Heimer  method)  projected  to  the 
posterior  hypothalamus,  a  region  known  to  support 
self-stimulation  in  rabbits15.  Thus,  lesions  in  the  critical 
regions  might  have  affected  the  normal  functioning  of 
brainstem  reward  circuits5.  This  is  not  an  unreasonable 
idea  because  a  conditioned  inhibitor  in  a  defensive  con¬ 
ditioning  task,  such  as  the  NMR  preparation,  reliably 
signals  the  nonoccurrence  of  the  (presumably  aversive) 
U S7.  Accordingly,  the  present  study  assessed  the  effects 
of  posterior  hypothalamic  lesions  on  Cl  performance. 

In  addition,  we  reexamined  Cl  performance  follow¬ 
ing  lesions  of  mesencephalic  regions  described  by 
Berthier  and  Moore1  and  Mis2H.  Unlike  the  former 
study1,  however,  in  which  animals  were  sacrificed  after 
three  daily  sessions  of  Cl  retraining,  we  allowed  enough 
post-operative  retraining  for  recovery  of  preoperatively 
established  Cl  to  manifest  itself.  We  also  assessed  pre- 
and  postoperative  Cl  in  both  eyes  in  this  group  of 
animals.  Examination  of  the  performance  of  both  eyes 
allowed  assessment  of  possible  effects  of  contralateral 
damage  and  general  arousal  or  stress. 


METHODS 

Animals 

Forty-one  mature  New  Zealand  albino  rabbits, 
obtained  from  a  licensed  local  supplier,  were  used  in 
this  study.  They  were  housed  individually  under 
24  h/dim  light  with  free  access  to  food  and  water.  Their 
weights  ranged  from  2.0-3. 3  kg  at  the  time  of  surgery. 
Sixteen  of  the  41  animals  were  dropped  from  the  study 
for  various  reasons:  (a)  six  failed  to  attain  the  preopera¬ 
tive  training  criterion  (see  below);  (b)  three  died  during 
the  postoperative  period;  (c) three  sustained  red 
nucleus  damage  that  interfered  with  their  ability  to 
make  CRs25;  (d)  in  four  cases,  lesions  failed  to  include 
structures  of  interest  in  this  study.  (There  was  no  evi¬ 
dence  of  Cl  interference  in  these  cases).  Of  the  remain¬ 
ing  25  animals,  Cases  1-11  sustained  hypothalamic 
lesions.  Cases  12-25  sustained  mesencephalic  lesions. 
The  hypothalamic  group  received  Cl  training  of  the 
right  eye,  as  described  below.  The  mesencephalic  group 
was  trained  and  tested  in  both  eyes. 

Apparatus 

Four  rabbits  were  run  concurrently  in  a  four-drawer, 
sound-attenuated,  and  ventilated  file  cabinet.  The 
apparatus  was  essentially  the  same  as  those  used  in 
previous  studies  from  this  laboratory'-2-17-18-20-13.  Each 
animal  was  confined  to  a  Plexiglas  rabbit  restrainer" 
and  fitted  with  a  minitorque  potentiometer  (Conrac 
85153)  that  had  been  affixed  to  a  headset.  The  poten¬ 


tiometer  was  coupled  to  the  nictitating  membrane  via  a 
loop  of  suture.  NMR  movements  were  then  recorded  as 
DC  voltage  changes  by  a  Grass  Model  5D  polygraph. 
A  CR  was  defined  as  a  positive  pen  deflection  of  at  least 
1  mm  within  the  CS-US  interval,  a  deflection  corre¬ 
sponding  to  an  NMR  of  0.5  mm. 

The  CS  +  during  Cl  training  was  a  light  (hereafter 
denoted  L  + )  delivered  by  a  single  6  V  incandescent 
lamp  located  behind  a  translucent  panel  approximately 
10  cm  in  front  of  the  animal’s  head.  The  CS  -  consisted 
of  the  light  CS  and  a  concurrent  tone  (1200  Hz,  85  dB 
SPL).  CS  -  trials  are  hereafter  denoted  LT-.  The 
duration  of  the  CS  on  both  types  of  trials  was  550  ms. 
On  L  +  trials,  the  light  occurred  with  the  US,  a  1.5  mA. 
60  Hz  shock,  at  an  interstimulus  interval  of  500  ms.  The 
US  was  delivered  across  two  9  mm  Clay-Adams 
wound  clips  affixed  to  the  inferior  and  posterior  mar¬ 
gins  of  the  eye. 

Cl  training 

Prior  to  the  initial  training  session,  a  suture  was 
placed  in  the  nictitating  membrane  for  attachment  to 
the  recording  potentiometer22.  The  wound  clips  for 
delivery  of  the  US  were  crimped  into  the  periocular 
marginal  tissue.  The  animals  were  restrained  and  habit¬ 
uated  to  the  apparatus  for  20  min  before  training  com¬ 
menced. 

Each  training  session  consisted  of  50  L  +  and 
50  LT  -  trials  arranged  pseudorandomly  so  that  no 
more  than  two  trials  of  the  same  type  occurred  con¬ 
secutively.  The  intertrial  interval  was  1 5  s.  Daily- 
sessions  were  given  until  each  subject  met  the  criterion 
of  at  least  90%  CRs  to  L  +  ,  and  less  than  30%  CRs  to 
LT  -  .  Cases  1-1 1  were  trained  on  the  right  eye  only,  i.e. 
the  US  was  applied  to  the  right  eye,  and  this  was  the 
eye  from  which  NMRs  were  recorded,  both  pre-  and 
postoperatively.  Cases  12-25  were  trained  on  the  left 
eye  to  criterion  after  attaining  criterion  on  the  right  eye. 
During  postoperative  testing,  however,  animals  in  this 
group  received  50  trials  on  one  eye  (25  L  +  and 
25  LT  - )  and  50  trials  on  the  other  eye  during  each 
daily  session,  the  order  alternating  from  one  day  to  the 
next. 

Surgical  procedures 

Following  attainment  of  the  Cl  criterion,  animals 
1-1 1  received  lesions  to  the  posterior  hypothalamic 
region.  Animals  12-25  received  lesions  of  the  mes¬ 
encephalon.  Animals  were  anaesthetized  by  injection  of 
chlorpromazine  (4  mg/kg,  i.m.)  followed  by  sodium 
pentobarbital  (22  mg/kg,  i.v.)  and  Xylocaine  (1%,  at 
points  of  incision).  Using  standard  stereotaxic  tech¬ 
niques,  the  lesioning  electrode  was  positioned  accord- 
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g  to  coordinates  obtained  from  Sawyer  et  al.27.  The 
sioning  electrode  consisted  of  a  00  stainless-steel 
sect  pin,  insulated  with  enamel  except  at  the  tip.  A 
idio-frequency  lesion  (Grass  Instruments  Model 
M4)  was  produced  by  passing  a  current  through  the 
ectrode  for  30  s,  increasing  from  0  to  20  mA  over  that 
me  period. 

Following  Berthier  and  Moore1,  animals  were  allow- 
1  three  days  for  recovery.  This  relatively  brief  recovery 
;riod  mitigated  secondary  degeneration  effects.  Rec- 
cery  was  followed  by  Cl  testing,  which  consisted  of 
-7  daily  Cl  retraining  sessions.  At  the  conclusion  of 
sting,  animals  were  then  overdosed  with  sodium 
jntobarbital  and  perfused  intracardially  with  0.9°o 
dine  followed  by  10°o  formalin.  Brains  were  removed, 
ored  in  formalin  for  3  days  and  then  stored  in  sucrose 
ir  3-4  days.  Coronal  60  pm  sections  were  made 
irough  the  lesioned  regions,  and  every  third  section 
as  mounted  and  stained  with  0.5 Cresyl  violet. 

nalvsis  of  Cl  performance 

A  Cl  disruption  index  (DI)  was  computed  for  each 
limal  using  the  formula  described  in  Berthier  and 
[oore1.  The  DI  was  computed  as  follows: 


RESULTS 

Lesion  reconstructions 

Figs.  1-4  are  reconstructions  of  lesions  from  the  25 
animals  that  completed  the  study.  Representative 
coronal  sections  are  numbered  by  their  rostral  distance 
in  millimeters  from  the  level  of  the  accessory  abducens 
in  histologically  prepared  tissue.  The  column  of  sections 
for  each  animal  runs  rostral  to  caudal  from  top  to 
bottom,  and  the  animal’s  right  appears  as  the  reader's 
right. 

Behavioral  data  were  excluded  from  subsequent  anal¬ 
yses  for  Cases  1  and  2  as  these  subjects  received  lesions 
of  the  optic  chiasm  (Fig.  1)  that  resulted  in  lowered 
responding  to  the  light  CS  +■ . 

Cl  performance :  hypothalamic  lesions 

Cases  3-1 1  received  hypothalamic  lesions  following 
preoperative  Cl  training  to  the  right  eye.  Table  1  indi¬ 
cates  that  animals  required  a  mean  of  5.56  (S.E.  =  0.75) 
preoperative  Cl  training  sessions  to  attain  criterion. 
The  grand  mean  for  the  DI s  was  0.30  (S.E.  =  0.10). 
None  of  these  animals  showed  disrupted  performance 
of  Cl ;  in  all  but  one  case,  the  increase  in  Dl  was  due 


t  C  Rs  to  L  +  pr,  -  C  Rs  to  LT  -  pr,. )-  ( C  Rs  to  L  +  p„„  -  C  Rs  to  LT  -  ^ ) 

( °„  C  Rs  to  L  +  -  °„  C  Rs  to  LT  -  prc) 


here  pre  refers  to  the  rate  of  responding  to  the  given 
imulus  on  the  last  training  session  before  lesioning, 
id  post  refers  to  the  rate  of  responding  on  the  first 
aining  session  after  lesioning.  Disruption  of  Cl  is  indi- 
ited  by  a  positive  value  of  DI,  improvement  of  Cl 
:rformance  is  indicated  by  a  negative  value  of  DI,  and 
)  change  in  performance  is  indicated  by  a  zero  value 
‘  DI.  Note  that  animals  subjected  to  mesencephalic 
sions  were  trained  preoperatively  and  postoperatively 
i  both  eyes.  Hence,  each  of  these  animals  contributed 
jo  D/s. 

Two  criteria,  both  involving  the  Dl.  were  used  to 
isignate  an  animal’s  Cl  performance.  Animals  with  a 
I  greater  than  the  mean  DI  for  their  group  (e  g. 
/pothalamic  or  mesencephalic)  met  one  criterion  for 
sruplion.  A  second  criterion  was  that  training  be  dis- 
ptcd  with  respect  to  responding  to  LT  -  ,  because  D/s 
in  be  increased  as  a  consequence  of  impaired  respond- 
g  to  L  +  . 


TABLE  I 

Animats  with  hypothalamic  lesions 

CRT.  number  of  sessions  required  for  the  Cl  criterion  of  attaining 
at  least  90'’,,  responding  to  L  +  and  at  most  30u„  responding  to 
LT  -  .  Pre  and  post  designations  refer  to  before  and  after  surgery, 
respectively.  LH.  lateral  hypothalamus;  PH,  posterior  hypothala¬ 
mus;  ZI.  zona  incerta. 


Case 

Dl 

CRT 

Primary 

lesion 

CRT 

Pre 

-- 

Post 

LH 

PH 

z/ 

11 

0.73* 

5 

X 

X 

6 

9 

0.72 

10 

X 

X 

4 

4 

0.49 

6 

X 

2 

10 

0.46 

8 

X 

X 

3 

5 

0.17 

5 

X 

2 

3 

0.13 

5 

X 

2 

7 

0.13 

3 

X 

3 

8 

0  12 

5 

X 

s 

6 

-  0.26 

3 

X 

1 

•The  only  animal  for  which  the  Dl  increase  was  due  to  increased 
responding  to  LT  -  . 


1  2  3  4  5  6 

f  ig.  I  Reconstruction  of  lesions  for  Cases  1-6.  C  he  first  vertical  column  of  this  figure  and  Figs.  2  and  3  contains  representative  transverse 
sections  of  the  rabbit  brain  from  anterior  commissure  to  the  red  nucleus.  Section  numbers  indicate  distances  (mm)  from  an  arbitrary  zero 
set  at  the  level  of  the  accessory  abducens  in  histologically  prepared  tissue.  Animal's  right  is  to  reader's  right.  Abbreviations:  F.  fornix;  MTT. 

mammillothalamic  tract;  OC.  optic  chiasm:  OT.  optic  tract. 
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TABLE  II 

Disrupted  animals  with  mesencephalic  lesions 

CRT,  number  of  sessions  required  for  criterion.  Pre  and  post  designations  refer  to  before  and  after  surgery,  respectively.  AOA,  accessory 
oculomotor  area;  HAB,  habenular  nucleus;  PCPT,  post-commissural  and  pretectal  area;  PAG,  periaqueductal  gray;  RN,  red  nucleus. 


Case 

Dl 

CRT 

Pre 

Primary  lesion 

CRT 

Post 

PCPT 

PAG 

AOA 

HAB 

RN 

15L 

0.81 

3 

X 

4 

12L 

0.75 

1 

X 

X 

X 

2 

22R 

0.64 

6 

X 

2 

20  L 

0.60 

7 

X 

4 

12R 

0.57 

5 

X 

X 

X 

5 

19L 

0.40 

2 

X 

2 

16R 

0.35 

3 

X 

X 

3 

23L 

0.33 

5 

X 

X 

X 

4 

20  R 

0.24 

7 

X 

1 

to  lowered  responding  to  L  + ,  and  the  sole  exception 
was  not  considered  disrupted  for  other  reasons  (case 
11,  see  below).  All  animals  eventually  recovered  cri¬ 
terion  Cl  performance  (mean  number  of  sessions 
required  to  criterion  =  2.8,  S.E.  =  0.49,  n  =  9). 

Table  I  summarizes  the  pre-  and  postoperative  Cl 
performance  of  animals  receiving  unilateral  or  bilateral 
lesions  to  the  hypothalamus.  Cases  3, 4,  5  and  7  test  the 


reward  system  hypothesis  of  Cl.  These  animals  ex¬ 
perienced  lesions  located  in  the  vicinity  of  the  lateral 
hypothalamus  (Fig.  1)  and  exhibited  classic  symptoms 
of  the  lateral  hypothalamic  syndrome5,  including 
aphagia  and  weight  loss.  With  regard  to  the  reward- 
system  hypothesis  stated  in  the  introduction,  the  lateral 
hypothalamus  has  been  shown  to  support  self-stimula¬ 
tion  in  the  rabbit15.  However,  for  these  animals. 


TABLE  III 


Non-disrupted  animals  with  mesencephalic  lesions 


CRT,  number  of  sessions  required  for  criterion.  Pre  and  post  designations  refer  to  before  and  after  surgery,  respectively.  AOA,  accessory 
oculomotor  area;  HAB,  habenular  nucleus,  PCPT,  post-commissural  and  pretectal  area;  PAG,  periaqueductal  gray;  RN,  red  nucleus. 

Case 

Dl 

CRT 

Pre 

Primary  lesion 

CRT 

Post 

PCPT 

PAG 

AOA  HAB  RN 

13R 

0.40* 

5 

X 

X 

2 

18L 

0.33* 

4 

X 

2 

25R 

0.29* 

5 

X 

2 

I4R 

0.27* 

4 

X 

X 

3 

2IL 

0.25* 

3 

X 

X 

3 

24  L 

0.16 

2 

X 

X 

1 

19R 

0.14 

4 

X 

1 

I7L 

0.12 

1 

X 

X 

1 

I4L 

0.05 

1 

X 

1 

I3L 

0.04 

2 

X 

3 

I8R 

0.04 

11 

X 

1 

23  R 

0.02 

5 

X 

1 

24R 

0.01 

5 

X 

X 

1 

25L 

0.01 

2 

X 

X 

1 

22L 

-0.06 

2 

X 

2 

15R 

-0.09 

6 

X 

I 

21 R 

-0.10 

10 

X 

X 

2 

17R 

-  0.19 

4 

X 

X 

1 

16L 

-0.28 

1 

X 

4 

•Animals  for  which  the  positive  value  of  Dl  was  due  to  lowered  responding  to  L+  . 
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responding  to  LT  -  was  unaffected  (preoperative  mean 
percent  CR  =  4.0,  S.E.  =  1 .4 ;  postoperative  mean  = 
9.75,  S.E.  =  4.2)  and  the  changes  in  DI  were  due  to 
transient  decreases  in  responding  to  L  +  (mean 
DI  =  0.23,  S.E.  =  0.09).  This  finding  supports  the  con¬ 
clusion  that  lateral  hypothalamic  lesions  do  not  aver- 
sively  affect  classical  conditioning10.  It  would  appear 
that  they  also  fail  to  affect  Cl.  The  failure  of  lateral 
hypothalamic  lesions  to  increase  responding  to  LT  - 
suggests  that  the  conditioned  inhibitor  does  not  serve  a 
rewarding  function. 

Cases  9,  10,  and  1 1  all  had  similar  bilateral  lesions  of 
the  posterior  hypothalamic  region  (Fig.  2),  and  showed 
a  transient  postoperative  disruption  of  Cl  performance. 
All  three  animals  displayed  marked  hyper-reactivity, 
were  difficult  to  restrain,  and  occasionally  emitted 


vocalizations  upon  application  of  wound  clips  and  dur¬ 
ing  the  initial  presentation  of  the  US.  Lesions  in  all  three 
cases  involved  the  zona  incerta  to  some  extent  (Fig.  2). 
Fibers  descending  from  this  region  (and  the  caudal 
hypothalamus  in  general)  have  been  proposed  as  com¬ 
prising  part  of  the  nociceptive  system24.  Even  well- 
trained  animals  will  show  elevated  responding  to  LT  - 
when  aroused  or  under  stress. 


Cl  performance :  mesencephalic  lesions 

Cases  12-25  received  mesencephalic  lesions  follow¬ 
ing  preoperative  Cl  training  to  both  eyes.  Tables  II  and 
III  indicate  that  left-eye  Cl  training  required  fewer 
sessions  to  attain  criterion  than  the  initial  right  eye 
training,  suggesting  a  savings  effect  (left  eye  mean  = 


Fig.  3.  Reconstructions  of  lesions  for  Cases  12-18,  Additional  abbreviations:  MB,  mammillary  bodies;  PAG,  periaqueductal  gray;  PC. 

posterior  commissure;  RN,  red  nucleus. 
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2.6,  S.E.  =  0.46;  right  eye  mean  =  5.7,  S.E.  =  0.61, 
t( 26)  =  4.113,  two-tailed  P  <  0.001). 

For  animals  that  sustained  mesencephalic  damage, 
the  overall  mean  for  the  DI s  (for  all  eyes,  n  =  28)  was 
0.217  (S.E.  =  0.05).  Eyes  with  DI s  greater  than  0.217 
that  were  not  due  to  deflated  responding  to  L  +  were 
classified  as  disrupted  (number  of  eyes  =  9,  mean 
DI  =  0.52,  S.E.  =  0.07),  and  the  remainder  were  classi¬ 
fied  as  nondisrupted  (number  of  eyes  =  19,  mean 
DI  =  0.074,  S.E.  =  0.04).  DI s  for  the  disrupted  eyes 
were  significantly  higher  than  those  for  non-disrupted 


eyes  (f(26)  =  5.923,  two-tailed  P  <  0.001).  As  we  shall 
further  discuss  below,  all  animals  eventually  recovered 
Cl  performance.  For  eyes  classified  as  disrupted,  the 
mean  number  of  post-operative  training  sessions  requir¬ 
ed  to  re-attain  Cl  criterion  was  significantly  higher  than 
for  non-disrupted  eyes  (Disrupted,  mean  =  3.0, 
S.E.  =  0.44;  Non-disrupted,  mean  =  1.7,  S.E.  =  0.21, 
r(26)  =  2.921,  two-tailed  P  <  0.010). 

Table  II  shows  that  Cases  12,  15,  16,  19,  20,  22,  and 
23  exhibited  transient  Cl  disruption  in  at  least  one  eye. 
Their  Cl  performance  returned  to  preoperative  levels 
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Fig.  4.  Reconstructions  of  lesions  for  Cases  19-25. 
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within  an  average  of  2.4  postoperative  sessions.  Cases 
with  little  or  no  Cl  disruption  are  summarized  in 

Table  III. 

PAG 

Damage  to  the  PAG  most  effectively  resulted  in  Cl 
disruption  when  lesion  placement  was  fairly  rostral  (at 
the  level  of  the  posterior  commissure,  for  example)  and 
medial  (immediately  surrounding  the  aqueduct).  Exam¬ 
ples  of  disrupted  cases  that  showed  this  pattern  include 
Case  12  (both  eyes,  Table  II,  Fig.  3),  Case  16  (right  eye, 
Table  II,  Fig.  3),  Case  19  (left  eye,  Table  II,  Fig.  4).  and 
Case  23  (left  eye,  Table  II,  Fig.  4).  In  these  cases  the 
lesion  sites  were  ipsilateral  to  the  affected  eye.  How¬ 
ever,  Case  20  (Table  II)  showed  disrupted  Cl  perform¬ 
ance  in  the  left  eye  despite  contralateral  damage  to  the 
PAG  (Fig.  4).  Examination  of  sections  falling  between 
sections  1 1.0  and  1 1.4  shown  in  Fig.  4  revealed  that  the 
lesion  partially  encircled  the  aqueduct.  Berthier  and 
Moore1  also  noted  contralateral  disruption  of  Cl  fol¬ 
lowing  this  type  of  lesion. 

PAG  lesions  that  were  caudal  to  the  PC  or  ventral  to 
the  aqueduct  produced  no  disruption  of  Cl.  Examples 
of  this  pattern  include  Cases  13  and  14,  Cases  17  and 
18,  the  right  eye  of  Case  19,  Case  21,  Case  24  and  25. 
The  specificity  of  the  placement  of  PAG  lesions  is  illus¬ 
trated  by  cases  in  which  one  PAG  lesion  was  more 
laterally  located  than  the  other,  resulting  in  good  Cl 
performance  in  one  eye  but  disrupted  performance  in 
the  other,  for  example  Case  19  (Tables  II  and  III, 
Fig.  4). 

Pre-commissural/pretectal  area 

Case  15  (Table  II)  received  a  unilateral  lesion  to  the 
pretectal  region  (Fig.  3).  In  agreement  with  the  Berthier 
and  Moore1  study,  this  animal  displayed  a  considerable 
increase  in  responding  to  LT  - ,  relative  to  preoperative 
performance.  This  case  contrasts  with  that  of  the  left 
eye  of  Case  18,  which  showed  a  decrease  in  responding 
to  L  +  ;  the  maximal  portions  of  the  lesion  for  Case  18 
tended  to  be  more  lateral  than  the  disrupting  lesion  of 
Case  15  (see  section  1 1.0  of  Fig.  3). 

Accessory  oculomotor  area 

Case  22  (Table  II)  received  a  unilateral  lesion  to  the 
right  accessory  oculomotor  nuclei  and  oculomotor 
nerve  (Fig.  4).  In  agreement  with  the  Berthier  and 
Moore1  study,  this  animal  showed  disrupted  Cl  per¬ 
formance  in  the  right  eye.  Cl  performance  in  the  contra¬ 
lateral  eye  was  unaffected  by  the  lesion,  and  perform¬ 
ance  in  the  ipsilateral  eye  returned  to  preoperative  levels 
in  2  sessions. 


DISCUSSION 

Summary 

The  present  study  showed  that  lesions  of  the  lateral 
and  posterior  hypothalamus  do  not  affect  retention  of 
Cl  of  the  NMR.  The  lateral  and  posterior  hypothala¬ 
mus  are  known  to  support  self-stimulation  in  the  rab¬ 
bit15  and  are  therefore  considered  to  be  components  of 
a  hypothalamic  reward  system.  Under  the  hypothal¬ 
amic  reward  system  hypothesis  of  Cl,  the  conditioned 
inhibitor  serves  a  reward  function  because  it  signals  that 
an  aversive  event,  the  US,  is  not  forthcoming1-7.  The 
present  experiment  failed  to  support  the  reward  system 
hypothesis  of  Cl,  but  does  not  rule  out  the  possibility 
that  the  reward  system  may  play  a  role  during  the  devel¬ 
opment  of  Cl.  Such  a  scenario  could  be  addressed  with 
studies  of  acquisition  of  Cl  following  lesions  of  the 
lateral  and  posterior  hypothalamus. 

The  present  study  also  showed  that  lesions  of  various 
mesencephalic  structures,  including  PAG,  pretectum, 
posterior  commissure,  and  accessory  oculomotor 
nuclei,  resulted  in  transient  disruption  of  Cl  that  eventu¬ 
ally  recovered.  The  disruption  of  Cl  was  previously 
shown  by  Berthier  and  Moore1 .  However,  these  investi¬ 
gators  did  not  observe  recovery  of  disrupted  Cl,  possi¬ 
bly  because  their  use  of  the  Fink-Heimer  method 
allowed  for  only  three  days  of  postoperative  retraining. 
In  the  present  study,  recovery  of  Cl  performance  fol¬ 
lowing  disrupting  lesions  did  not  become  evident  until 
after  three  postoperative  sessions  in  six  of  the  eight 
animals  judged  to  have  been  disrupted. 

It  is  possible  that  stress  or  impaired  auditory  infor¬ 
mation  processing  contributed  to  transient  disruptions 
of  Cl  performance.  We  have  indicated  that  arousal  and 
stress  (e.g.  from  irritation  of  periocular  tissue)  can  ele¬ 
vate  responding  on  CS  -  trials.  In  the  present  study, 
care  was  taken  to  mitigate  these  factors  and  to  take 
them  into  account  when  they  occurred.  Disruptions  of 
Cl  in  the  group  with  hypothalamic  lesions  could  be 
accounted  for  by  heightened  arousal,  as  in  Cases  9-11. 
By  contrast,  Cl  disruption  in  the  group  with  mes¬ 
encephalic  lesions,  Cases  12,  15,  16,  19,  20,  22,  and  23, 
did  not  appear  to  involve  these  factors.  It  is  unlikely  that 
impaired  auditory  information  processing  contributed 
to  Cl  disruption  in  the  present  study.  Mis20  showed  that 
Cl-disrupted  animals  with  mesencephalic  lesions  could 
acquire  a  CR  to  a  tone  conditioned  inhibitor,  and  in  the 
present  study  we  observed  several  cases  where  Cl  dis¬ 
ruption  appeared  only  in  one  eye.  Good  Cl  perform¬ 
ance  in  one  eye  suggests  that  the  auditory  system  was 
functioning  normally,  since  the  fibers  of  lateral  lemnis¬ 
cus,  the  principal  auditory  pathway  in  the  brain  stem, 
are  both  crossed  and  uncrossed6. 
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Alternative  hypotheses  for  Cl  of  the  NMR 

It  has  been  suggested  that  mesencephalic  lesions 
affect  a  generalized  inhibitory  system  for  the  extraocular 
muscles20.  The  evidence  for  such  a  system  received 
some  support  in  the  present  study  because  of  the  trans¬ 
fer  of  training  observed  in  the  animals  trained  first  on 
the  right  eye  and  then  on  the  left  (Tables  II  and  III).  On 
the  other  hand,  this  construct  would  have  difficulty 
accounting  for  the  cases  in  which  lesions  affected  Cl 
performance  in  only  one  eye,  a  situation  which  parallels 
lesion  data  showing  that  CRs  can  be  disrupted  in  one 
eye  without  affecting  either  the  acquisition  or  savings  in 
the  other  eye25. 

Because  the  conditioned  NMR  is  based  on  an  aver¬ 
sive  US,  and  mindful  of  reports  that  stimulation  of  the 
pretectal  region  and  the  PAG  produces  analgesia, 
Moore  et  al.  suggested  that  the  presentation  of  LT  -  in 
this  task  triggers  the  release  of  endogenous  opioid  pep¬ 
tides23.  However,  naloxone,  an  opiate  antagonist,  does 
not  impair  Cl  performance2. 

Cl  tasks  require  the  active  suppression  of  CRs  in  the 
presence  of  the  conditioned  inhibitor.  Such  a  selection 
of  behavioral  strategy  ( not  responding)  could  be  sub¬ 
served  by  the  diencephalic  conduction  system8,30  de¬ 
scribed  by  Sutherland29.  The  diencephalic  conduction 
system,  situated  between  limbic  forebrain  and  brain¬ 
stem  regions,  includes  the  septal  nuclei,  long  regarded 
as  candidate  structures  for  the  mediation  of  inhibition, 
and  the  habenular  nuclei,  which  have  been  hypothe¬ 
sized  to  form  a  processing  station  between  tel¬ 
encephalon  and  mesencephalon26. 

Several  lines  of  evidence  suggest  that  the  septal  and 
habenular  nuclei  are  involved  in  Cl.  Lesions  of  the 
septum  produced  increased  responding  to  the  CS  -  in 
two-tone  differential  conditioning  of  the  NMR16. 
Recordings  of  multiple-unit  activity  in  lateral  septum 
showed  an  increase  in  firing  during  US  offset  and  dur¬ 
ing  presentation  of  a  CS  -  during  aversive  conditioning 
in  rat31.  Neither  of  these  studies  were  genuine  Cl  tasks 
because  the  CS  -  s  were  not  compounds  which  includ¬ 
ed  the  CS  +  .  Pilot  septal  lesion  studies  in  our  laboratory 
using  the  L  +  /LT  -  task  have  yielded  ambiguous 
results  because  disruptions  of  Cl  performance  were 
transient  and  in  some  instances  manifested  themselves 
as  decreased  responding  to  L  + ,  as  well  as  elevated 
responding  to  LT  -  (Blazis,  unpublished  observations). 
The  possibility  that  the  habenular  nuclei  might  be 
involved  in  Cl  of  the  NMR  is  supported  in  the  present 
study  by  the  disrupted  performance  of  Case  12,  an  ani¬ 
mal  that  sustained  damage  to  the  habenular  nucleus. 
Finally,  the  septal  and  habenular  nuclei  are  anatomi¬ 
cally  well-situated  to  influence  Cl  via  projections 
through  fasciculus  retroflexus  to  the  accessory  oculo¬ 


motor  nuclei,  pretectal  region,  the  PAG,  and  reticular 
formation13,14.  Thus,  transections  of  fasciculus  retro¬ 
flexus  could  further  illuminate  the  role  of  the  di¬ 
encephalic  conduction  system  in  CI. 
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A  MECHANISM  FOR  TIMING  CONDITIONED  RESPONSES 


J.  W.  MOORE 

Departments  of  Psychology  and  Computer  Science 
University  of  Massachusetts — Amherst 
Amherst,  Massachusetts,  01003 

ABSTRACT.  Classical  conditioning  procedures  instill  knowledge  about  the  temporal 
relationships  between  conditioned  stimuli,  which  are  regarded  as  predictive  signals 
and  triggers  for  action,  and  the  unconditioned  stimulus,  the  event  to  be  timed.  This 
knowledge  is  expressed  in  the  temporal  features  of  the  conditioned  response,  which 
typically  develop  such  that  its  peak  amplitude  occurs  at  times  when  the  unconditioned 
stimulus  is  expected.  A  simple  connectionist  network,  comprised  of  two  neuron-like 
processing  units,  provides  a  mechanism  that  can  acount  for  virtually  all  aspects  of 
conditioned  response  timing.  The  unfolding  of  time  from  the  onsets  and  offsets  of 
events  such  as  conditioned  stimuli  is  represented  by  the  propagation  of  activity  along 
delay  lines.  Input  to  the  two  processing  units  from  conditioned  stimuli  arise  from 
collateral  taps  off  of  each  sequential  element  of  these  delay  lines. 

1.  Introduction 

Psychologists  interested  in  time,  action,  and  cognition  do  not  typically  attend  to  re¬ 
search  on  classical  conditioning  (Block,  1990).  One  reason  for  this  is  that  conditioned 
responses  reside  in  the  domain  of  learning,  not  cognition  and  perception.  Classical 
conditioning  does  not  engage  the  mind — it  proceeds  beneath  the  veneer  of  conscious 
awareness.  Psychologists  are  interested  in  impressions  and  judgements  about  time. 
Conditioned  responses  are  time  veridical — they  reflect  real  time  rather  than  perceptu¬ 
ally  distorted  impressions  of  elapsed  time.  These  properties  of  conditioned  responses 
make  them  attractive  to  neuroscientists  and  computational  modellers  interested  in  real¬ 
time  motor  control  and  its  underlying  neural  mechanisms  (Gabriel  and  Moore,  1990). 
This  community  of  scholars  regards  the  conditioned  response  as  a  microcosm  for  elu¬ 
cidating  behavioral  principles  of  wide  generality  and  for  discovering  mechanisms  for 
their  expression. 

This  chapter  summarizes  some  facts  about  the  timing  of  conditioned  responses  and 
then  presents  a  neural  network  model  that  can  accommodate  them.  From  now  on,  I 
use  the  following  standard  abbreviations:  CS  for  conditioned  stimulus,  US  for  uncon¬ 
ditioned  stimulus,  CR  for  conditioned  response,  and  UR  for  unconditioned  response. 


1 


1.1.  Conditioning  and  Cognition 

Despite  its  traditional  emphasis  on  the  principles  of  behavioral  learning,  it  is  of¬ 
ten  convenient  to  express  the  outcome  of  classical  conditioning  in  terms  of  acquired 
knowledge.1  Perhaps  the  most  basic  thing  learned  in  classical  conditioning  is  that  the 
CS  predicts  the  US.  Prediction  is  the  key  to  understanding  conditioning  because  a 
CS’s  capacity  to  control  behavior  depends  on  the  degree  to  which  it  is  a  reliable  and 
nonredundant  signal  that  the  US  will  occur.  Subjects  learn  to  ignore  stimuli  that  are 
poor  predictors  of  the  US,  and  they  learn  to  suppress  CRs  to  stimuli  (conditioned 
inhibitors)  that  predict  the  withholding  of  an  otherwise  anticipated  US. 

In  addition  to  expressing  knowledge,  a  CR  often  possesses  the  elements  of  skill. 
Its  topographical  features — latency,  rise-time,  peak  amplitude — typically  vary  from 
one  set  of  procedures  to  the  next  in  such  a  way  that  they  are  appropriate  to  the 
‘task  demands’  imposed  by  training  parameters  (Levey  and  Martin,  1968).  The  main 
evidence  for  this  adaptive  character  of  the  CR  is  that  these  topographical  features  vary 
systematically  with  the  CS-US  interval  employed  in  training.  (The  CS-US  interval  is 
typically  abbreviated  ISI,  for  ‘interstimulus  interval’.)  In  particular,  eye  blink  CRs  are 
‘temporally  adaptive.’  Temporal  adaptability  simply  means  that  the  peak  amplitudes 
of  CRs  occur  within  a  restricted  temporal  window  that  also  contains  the  US.  In  this 
sense,  CRs  reflect  the  knowledge  that  the  US  occurs  at  a  specific  time  after  the  CS. 
Recent  evidence  for  this  assertion  is  reviewed  later.  For  now,  it  suffices  to  say  that 
subjects  learn  not  only  to  expect  the  US  in  the  presence  of  the  CS,  but  also  when  to 
expect  it. 

1.2.  Mechanisms  of  Knowledge  Acquisition  and  Expression 

Classical  conditioning  procedures  establish  knowledge  about  timing.  What  are  the 
mechanisms  that  bring  this  about?  What  happens  in  the  brain  that  might  explain 
the  temporally  adaptive  properties  of  a  conditioned  eye  blink,  for  example?  Learning 
theorists  and  neuroscientists  alike  believe  that  the  knowledge  instilled  by  conditioning, 
and  the  accompanying  rules  for  generating  CRs,  arise  from  ‘associative  mechanisms.’ 
These  mechanisms  are  captured  by  mathematical  models  that  take  the  form  of  rules 
for  changing  the  strength  of  the  ‘synaptic  connection  weights’  between  representations 
of  the  CS  and  the  CR.  Such  rules  consist  of  two  factors — one  factor  is  the  level  of  CS 
processing;  the  other  factor  is  the  level  of  US  processing  (Desmond,  1990;  Dickinson 
and  Mackintosh,  1978;  Sutton  and  Barto,  1990;  Rescorla,  1988). 

laying  that  conditioning  procedures  produce  knowledge  does  not  contradict  the  earlier  statement 
that  CRs  arise  from  unconscious  processes  (Kihlstrom,  1987). 
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2.  CR  Waveforms  and  CS-US  Intervals 


Y(t) 


CS 

US 


Y(t) 


CS 

US 


Y(t) 


CS 

US 

Figure  1.  Effects  of  changing  US  timing  on  simulated  CR  topography,  Y(t).  Top: 
Topography  after  25  short  CS-US  interval  training  trials  in  Stage  1.  Middle:  In  Stage 
2,  the  CS-US  interval  is  lengthened.  After  10  trials,  the  short-latency  CR  is  somewhat 
diminished  and  the  longer-latency  CR  begins  to  develop.  Bottom:  After  30  Stage  2 
trials,  tranformation  of  CR  topography  is  nearly  complete.  Copywrite  1989,  Springer- 
Verlag. 

Conditioned  response  waveforms  are  functions  of  the  CS-US  interval  used  in  train¬ 
ing.  Long  CS-US  intervals  give  rise  to  delayed  CRs,  which  Pavlov  attributed  to  an 
active  inhibitory  process  which  persists  until  the  US  is  imminent  (‘inhibition  of  de¬ 
lay’).  There  is  little  evidence  to  support  Pavlov’s  explanation  of  the  delayed  temporal 
placement  of  CRs.  Instead  of  being  due  to  inhibition,  the  phenomenon  of  delayed  CR 
placement  is  more  likely  attributable  to  the  fact  that  a  CR  generated  by  a  long  CS-US 
interval  is  a  different  response  from  that  generated  by  a  shorter  CS-US  interval. 
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That  a  CR  generated  with  one  CS-US  interval  can  be  regarded  as  being  a  different 
response  from  one  generated  with  a  different  CS-US  interval  is  attested  to  by  studies 
in  which  subjects  are  trained  with  a  short  CS-US  interval  and  then  shifted  to  a  longer 
CS-US  interval.  Typically,  the  CR  in  the  temporal  window  defined  by  the  short  CS- 
US  interval  undergoes  extinction  while  a  new  CR  emerges  in  a  window  defined  by 
the  longer  CS-US  interval.  It  is  not  the  case  that  the  original  CR  migrates  to  the 
new  temporal  window.  It  remains  within  its  original  window  but  progressively  loses 
amplitude  while  at  the  same  time  the  new  CR  emerges  in  the  time  window  defined  by 
the  new  US  locus.  This  is  illustrated  in  Figure  1,  which  is  a  simulation  from  the  VET 
neural  network  model  discussed  later  on. 

Additional  evidence  for  the  temporal  specificity  of  CRs  comes  from  a  widely  cited 
study  of  rabbit  eye  blink/nictitating  membrane  conditioning  by  Millenson,  Kehoe,  and 
Gormezano  (1977).  Their  training  protocol  consisted  of  mixing  two  CS-US  intervals, 
one  of  400  msec  and  another  of  700  msec.  There  were  occasional  ‘probe  trials’  on  which 
the  CS  was  presented  without  the  US  for  either  400  or  700  msec.  On  400-msec  probes, 
response  topography  showed  a  peak  appropriate  to  the  400-msec  CS-US  interval.  On 
700-msec  probes,  response  topography  revealed  two  peaks — one  appropriate  for  the 
shorter  interval  and  another  appropriate  for  the  longer  interval.  This  finding  implies 
that  subjects  learned  If  the  CS  extends  beyond  400  msec,  initiate  another  CR;  if  it 
does  not,  do  nothing.  However  one  chooses  to  phrase  it,  the  implication  remains  that 
subjects  learned  not  one  CR  but  two,  one  appropriate  for  each  CS-US  interval  it 
experienced. 

2.1.  CR  Waveforms  and  Trace  Conditioning 

The  Millenson  et  al.  (1977)  experiment  used  a  delay  conditioning  protocol,  which  is 
technical  jargon  for  the  fact  that,  on  training  trials,  CS  onset  preceded  the  US  and 
stayed  ‘on’  until  the  US  occurred,  at  which  time  it  went  ‘off.’  But  what  of  trace 
conditioning  protocols  in  which  CS  onset  precedes  the  US  but  goes  off  beforehand? 
Where  do  subjects  place  their  CRs:  during  the  CS’s  ‘on’  phase  or  during  its  ‘off’ 
phase?  As  in  the  case  of  delay  paradigms,  CRs  occur  near  the  US,  so  CRs  occur 
during  the  ‘off’  phase. 

In  trace  conditioning  there  are  two  possible  CS-US  intervals,  one  defined  by  CS 
onset  and  the  other  defined  by  CS  offset.  Hence,  two  things  might  be  learned:  the  US 
follows  CS  onset;  the  US  follows  CS  offset.  Which  event,  CS  onset  or  offset,  defines 
the  temporal  window  in  which  to  place  CRs?  The  answer  is  both ,  although  this  is 
constrained  by  such  details  as  the  CS’s  duration  and  the  time  between  its  offset  and  the 
US,  the  so-called  trace  interval.  Support  for  this  conclusion  comes  from  an  experiment 
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by  Desmond  and  Moore  (1991a).  They  trained  rabbits  using  a  trace  conditioning 
protocol  in  which  the  CS  was  a  150-msec  tone  followed  200  msec  later  by  the  US, 
giving  a  nominal  CS-US  interval  of  350  msec.  The  US  was  a  mild  eye  shock,  and 
the  CR  was  extension  of  the  nictitating  membrane.  A  second  group  of  animals  were 
trained  in  a  delay  conditioning  procedure  in  which  the  tone  was  of  350  msec  duration. 


Figure  2.  Average  CR  waveforms  from  training  and  probe  trials  for  the  Trace  and 
Delay  groups  of  Desmond  and  Moore  (1991a).  Fine-grain  bars  on  waveforms  during 
probe  trials  are  standard  error  bars.  Vertical  cursors  correspond  to  expected  times  of 
the  US  with  respect  to  CS  onset  and  offset.  Copywrite  1991,  Springer- Verlag. 
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After  training,  subjects  in  both  the  Trace  and  Delay  groups  were  given  probe  trials 
without  the  US.  These  consisted  of  presentations  of  the  tone  for  durations  of  150, 
400,  and  600  msec.  As  Figure  2  shows,  the  two  longer  duration  tones  often  resulted  in 
bimodal  (double  peaked)  CR  waveforms  in  the  Trace  group,  but  not  in  the  Delay  group. 
The  initial  peak  was  located  350  msec  after  tone  onset,  within  the  temporal  window 
defined  by  the  interval  between  CS  onset  and  the  US.  The  second  peak  was  located  200 
after  tone  offset,  within  the  temporal  window  defined  by  the  interval  between  CS  offset 
and  the  US.  This  second  peak,  though  inappropriate  for  the  nominal  CS-US  interval 
of  350  msec,  is  appropriate  for  the  CS-US  interval  of  200  msec  defined  in  terms  of 
tone  offset.  Thus,  for  example,  on  a  typical  600-msec  probe  trial,  one  peak  appeared 
350-msec  after  tone  onset  and  the  other  appeared  800  msec  after  tone  onset.  Hence, 
the  following  knowledge  was  acquired:  The  US  follows  CS  onset  by  350  msec;  The  US 
follows  CS  offset  by  200  msec.  Let  us  turn  now  to  considering  how  the  ‘motor  program’ 
Initiate  a  CR  such  that  peak  amplitudes  correspond  to  the  times  of  the  US  might  be 
derived  from  this  knowledge. 

3.  The  VET  Model 

Desmond  and  Moore  (1988)  proposed  a  neural  network  model  capable  of  simulating  the 
features  of  CR  timing  described  above  (see  also,  Desmond,  1990;  Moore,  Desmond,  and 
Berthier,  1989).  We  refer  to  this  model  by  the  mnemonic  VET  in  order  to  emphasize  its 
function  of  mapping  associative  values  onto  action  based  on  expectancies  about  timing. 
The  model  assumes  that  CSs  trigger  propagated  activity  in  the  nervous  system.  In  its 
simplest  form,  this  activation  can  be  represented  by  a  delay  line.  A  ‘tap’  or  collateral 
from  each  element  of  the  delay  line  encodes  the  time  after  the  activation  has  been 
triggered  by  the  CS.  Each  potential  CS  has  its  own  set  of  delay  line  elements  which 
are  anatomically  associated  with  its  modality.2  In  addition  to  time-tagged  stimulus 
elements,  there  are  two  processing  units  where  learning  occurs.  One  unit  associates 
active  stimulus  elements  with  the  US  and  passes  this  information  to  the  other  unit, 
which  uses  this  information  to  generate  appropriate  (adaptively  timed)  CR  waveforms. 
The  assumed  delay-line  representation  of  time  enables  these  two  processing  units,  which 
are  thought  to  reside  within  cerebellar  cortex,  to  treat  CS-initiated  input  as  a  sequence 
of  discrete  events. 

In  addition  to  the  simulation  shown  in  Figure  1  and  the  results  of  the  Desmond 
and  Moore  (1991a)  trace  conditioning  experiment  (Figure  2),  the  VET  model  correctly 
predicts  that,  as  in  the  case  of  delay  conditioning,  CR  waveforms  in  trace  conditioning 

JDesmond  (1990)  describes  an  extension  of  the  simple  delay  line  representation  of  the  CS  into  a  pla¬ 
nar  array.  The  planar  array  representation  can  encompass  stimulus  generalisation  and  discrimination. 
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peak  at  the  point  of  US  onset,  that  is,  within  the  trace  interval.  The  model  also 
predicts  that,  with  long  CS-US  intervals,  CRs  do  not  begin  until  the  US  is  imminent, 
the  phenomenon  that  Pavlov  attributed  to  ‘inhibition  of  delay.’  Finally,  the  model 
predicts  the  outcome  of  experiments  with  multiple  CS-US  intervals  such  as  the  study 
by  Millenson  et  al.  (1977),  which  showed  that  training  with  randomly  mixed  trials 
having  CS-US  intervals  of  200  and  700  milliseconds  gives  rise  to  CRs  with  two  peaks, 
each  centered  at  a  time  of  US  onset. 


ca  us 


Figure  3.  Diagram  of  the  VET  network.  CS  onset  and  CS  offset  are  assumed  to  activate 
separate  tapped  delay  lines  that  project  to  the  V  and  E  units,  as  explained  in  the  text. 
Copy  write  1991,  Springer- Verlag. 

The  structural  components  of  the  VET  model  are  depicted  in  Figure  3.  The  two 
neuron-like  processing  units  receive  convergent  input  from  CSs  and  the  US.  The  V- 
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unit  is  the  output  device  that  generates  CR  topography.  It  has  modifiable  synaptic 
weights  that  are  changed  according  to  a  competitive  learning  rule.  Weight  changes 
depend  on  local  ‘eligibility’  factors,  a  global  parameter  dependent  upon  the  ISI,  and 
a  reinforcement  signal  that  reflects  the  expected  time  of  occurrence  of  the  US.  The 
learning  (weight  update)  rule  contains  two  reinforcement  factors:  one  is  contributed 
directly  by  the  US;  the  second  is  contributed  by  the  E  unit,  which  learns  when  the  US 
occurs  with  respect  to  CS  onsets  and  offsets.  Both  must  exceed  zero  for  weight  changes 
on  the  V  unit  to  occur. 


Input 


Processing 

Units 


Figure  4.  Basic  tapped  delay  fine.  Injection  of  CS  input  begins  sequential  propagation 
of  signal  through  a  delay  line.  Each  ‘synapse’  introduces  a  delay;  the  total  delay  from 
activation  of  the  first  element  of  the  delay  line  to  the  last  element  is  a  direct  function  of 
the  number  of  intervening  sequential  ‘synapses’  and  the  conduction  speed  of  propagated 
activity  in  the  cascade.  Taps  from  the  delay  line  elements  send  time-tagged  information 
to  higher  order  processing  units.  Copywrite  1988,  Springer- Verlag. 

Like  the  V  unit,  the  E  unit  receives  convergent  input  from  CSs  and  the  US,  and  it 
has  modifiable  synaptic  weights  that  are  changed  according  to  a  simple  linear  difference 
equation  that  includes  local  eligibility  factors  and  the  global  ISI  parameter.  By  pro¬ 
viding  a  precisely  timed  positive  signal  to  the  V  unit,  the  E  unit  prevents  the  eventual 
extinction  of  positive  weights  from  input  elements  to  the  V  unit,  thereby  permitting 
CR  waveforms  to  anticipate  the  US.  Without  this  mechanism,  the  output  of  the  V  unit 
would  over  the  course  of  training  be  positive  only  within  time  steps  that  also  contain 
the  US. 

Conditioned  stimuli  are  provided  with  a  temporal  dimension  through  tapped  delay 
lines  (Figure  4)  that  encode,  not  only  the  source  of  the  stimulus  (e.g.,  a  particular 
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component  of  a  compound  CS),  but  also  the  time  since  the  stimulus  began. 

Another  set  of  tapped  delay  lines  encodes  the  time  since  the  stimulus  ceased.  Thus, 
the  model  assumes  the  existence  of  separate  and  independent  timed-tagged  input  ele¬ 
ments  for  both  stimulus  onset  and  offset.  Figure  5  illustrates  how  activation  of  delay 
line  elements  are  triggered  by  CS  onset  and  offset. 


Offset 

Process 


Figure  5.  Onset  and  offset  processes  for  a  single  CS.  Time  progresses  from  left  to  right. 
Each  horizontal  bar  below  the  CS  represents  the  activation  time  of  an  individual  input 
element.  The  figure  illustrates  the  overlapping  activation  times  of  individual  elements 
in  the  onset  and  offset  processes.  This  feature  of  the  model  allows  for  continous  and 
‘smooth’  ramping  of  the  CR  from  a  zero  baseline  position  to  its  peak  amplitude  at  the 
expected  time  of  the  US,  as  illustrated  in  Figures  1  and  2.  Copywrite  1988,  Springer- 
Verlag. 

4.  Brain  Implementation  of  the  VET  Model 

Because  of  their  crucial  involvement  in  eye  blink  conditioning,  we  sought  to  align  the 
VET  model  with  the  cerebellum  and  associated  brainstem  structures  (Moore  et  al . , 
1989).  We  hypothesize  that  E  units,  which  learn  when  the  US  occurs,  are  Golgi  cells 
and  that  V  units,  which  are  Purkinje  cells,  use  this  information  to  generate  an  output 
which  ultimately  produces  a  temporally  adaptive  CR.  In  brief,  Golgi  cells  learn  when 
USs  occur  in  relation  to  CS  onsets  and  offsets,  and  Purkinje  cells  learns  how  to  generate 
appropriately  timed  CRs  and  their  topographical  features. 

Where  does  the  knowledge  that  The  CS  predicts  the  US  arise,  and  what  role  does 
it  play  in  the  development  of  adaptively  timed  CRs?  We  have  suggested  that  this 
knowledge  comes  about  through  simple  Hebbian  learning  among  brainstem  neurons. 
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These  neurons  provide  a  ‘coarsely  coded’  version  of  the  CR — one  lacking  the  temporal 
specificity  of  the  real  thing.3  Their  activation  by  the  CS  is  conveyed  to  cerebellar  cortex 
where  it  is  fashioned  into  the  appropriate  ‘finely  coded’  CR  waveform.  Specifically, 
the  activation  of  the  brainstem  neurons  instantiates  The  CS  predicts  the  US.  This 
activation  is  manifest  as  a  burst  of  firing  that  persists  for  at  least  the  duration  of 
the  CS-US  interval.  When  projected  to  the  granule  cell  layer  of  the  cerebellum,  it  is 
intercepted  by  Golgi  cells  (E  units)  at  the  mossy  fiber/granule  cell  interface. 

The  Golgi  cells  have  learned  to  release  their  normal  inhibitory  hold  on  input  from 
the  brainstem  neurons  but  only  momentarily  and  at  times  relative  to  the  CS  when  the 
US  has  occurred  in  the  past.  This  release  of  inhibition  permits  the  activation  from 
the  brainstem  neurons  to  proceed  via  parallel  fibers  to  the  Purkinje  cells  (V  units) 
where  it  can  reinforce  synaptic  modifications  of  active  inputs  from  the  tapped  delay 
line  mechanism.  In  other  words,  Golgi  cells  encoding  The  US  follows  the  CS  by  x 
amount  of  time  interact  with  activation  arising  from  the  brainstem  neurons  in  such 
a  way  as  to  provide  the  temporal  specificity  needed  to  instruct  the  Purkinje  cells  to 
Initiate  a  CR  such  that  the  peak  amplitude  occurs  at  the  time  of  the  US. 

The  delay  lines  illustrated  in  Figures  3  and  4  are  not  in  the  cerebellum  but  are 
extrinsic  to  this  structure.  Although  their  location  has  not  been  specified  or  experi¬ 
mentally  determined,  their  existence  ought  to  be  evident  in  the  firing  of  neurons  that 
project  to  the  cerebellum.  The  most  likely  place  to  find  such  evidence  would  be  in 
the  CS-evoked  activity  recorded  from  neurons  of  the  pontine  nuclei,  which  is  a  major 
source  of  mossy  fiber  input  to  the  cerebellar  cortex.  This  activity  would  tell  us  whether 
information  is  sent  to  the  cerebellum  in  the  manner  implied  by  Figures  4  and  5.  How¬ 
ever,  it  would  not  inform  us  about  which  precerebellar  structures  are  involved  in  its 
manifestation — a  task  that  could  be  approached  with  fiber-tracing  methods. 

One  candidate  for  tapped  delay  lines  is  the  reticular  core  of  the  brain,  as  has 
been  suggested  by  Scheibel  and  Scheibel  (1967).  Reticular  formation  neurons  can  fire 
sustained  bursts  to  a  CS  (Richards,  Ricciardi,  and  Moore,  1991),  they  provide  a  wide 
range  of  possible  propagation  speeds,  which  are  subject  to  modulation  by  local  and 
distal  processes,  and  their  axons  show  extensive  collateralization,  which  could  provide 

3Desmond  and  Moore  (1986)  reported  that  the  brainstem  contains  neurons  that  behave  in  the 
manner  imagined  in  this  scheme.  For  example,  CS-evoked  firing  in  some  supratrigeminal  reticular 
formation  neurons  predict  CR  amplitude,  across  a  series  of  trials,  but  not  CR  latency.  Some  red 
nucleus  neurons  behave  in  this  manner  (Desmond  and  Moore,  1991b).  By  contrast,  many  cells  in  the 
deep  cerebellar  nuclei  show  CS-evoked  firing  patterns  that  are  highly  predictive  of  both  CR  amplitude 
and  latency  (Berthier,  Barto,  and  Moore,  1991). 
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the  taps  depicted  in  Figure  4. 
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